-- Logs begin at Wed 2022-05-04 17:10:49 UTC, end at Wed 2022-05-04 18:44:29 UTC. -- May 04 17:55:18.574823 dv-cinder-840511-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 17:55:18.585450 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 17:55:18 2022] *** May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: nodename: dv-cinder-840511-4-iscsi May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: machine: x86_64 May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: clock source: unix May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: pcre jit disabled May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: detected number of CPU cores: 4 May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: current working directory: / May 04 17:55:18.587464 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: detected binary path: /usr/bin/uwsgi-core May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: your processes number limit is 47680 May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: your memory page size is 4096 bytes May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: detected max file descriptor number: 2048 May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: lock engine: pthread robust mutexes May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: thunder lock: enabled May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 17:55:18.588130 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 17:55:18.633973 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: Python main interpreter initialized at 0x55dd014119c0 May 04 17:55:18.633973 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: python threads support enabled May 04 17:55:18.633973 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: your server socket listen backlog is limited to 100 connections May 04 17:55:18.633973 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: your mercy for graceful operations on workers is 90 seconds May 04 17:55:18.634350 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: mapped 403077 bytes (393 KB) for 2 cores May 04 17:55:18.634427 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: *** Operational MODE: preforking *** May 04 17:55:18.634676 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: *** uWSGI is running in multiple interpreter mode *** May 04 17:55:18.634676 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: spawned uWSGI master process (pid: 80414) May 04 17:55:18.634889 dv-cinder-840511-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 17:55:18.636018 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: spawned uWSGI worker 1 (pid: 80415, cores: 1) May 04 17:55:18.636018 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: spawned uWSGI worker 2 (pid: 80416, cores: 1) May 04 17:55:18.636018 dv-cinder-840511-4-iscsi devstack@keystone.service[80414]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 17:55:24.358960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:55:24.358960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: from cryptography.utils import int_from_bytes May 04 17:55:24.359751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:55:24.359751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: from cryptography.utils import int_from_bytes May 04 17:55:24.360203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:55:24.360203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: from cryptography.utils import int_from_bytes May 04 17:55:24.360306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:55:24.360306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: from cryptography.utils import int_from_bytes May 04 17:55:24.409368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 17:55:24.409557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 17:55:24.409653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 17:55:24.409744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] command line args: [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 17:55:24.409818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 17:55:24.409975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] command line args: [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 17:55:24.410058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 17:55:24.410138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ================================================================================ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 17:55:24.410247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 17:55:24.410382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] admin_token = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.410467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ================================================================================ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 17:55:24.410626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_dir = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.410706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] admin_token = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.410813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.410894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config_dir = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_source = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] debug = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config_source = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] debug = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.411921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.412957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_config_append = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_config_append = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_dir = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_dir = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.413948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414147 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.414981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.415996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.416082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.416245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.416323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.416492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.416572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.416770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] publish_errors = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] publish_errors = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.417944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] standard_threads = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] standard_threads = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.418954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_journal = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_json = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_journal = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_stderr = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_json = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_syslog = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.419993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_stderr = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.420069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.420151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_syslog = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.420246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.420331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:55:24.420482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.420566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.420731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.420816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.420964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.421994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.422160 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.422255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.422401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.422478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.422646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.422728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.423393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.423656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.423837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.423931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.424999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.425974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.426932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.427964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.428910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.429957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.430928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.431859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.432912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.433931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.434859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.435959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.436979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.437938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.438083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.438169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.438317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.438403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.438585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.439325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.439421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.439561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.439646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.439812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.439972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.440938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.441992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.442927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.443872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444101 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.444946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.445896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.external = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.external = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.446875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.password = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.token = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.password = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.token = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.447980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.448921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.449960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.450915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.451086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.451181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.451623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.451716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.451852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.451942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.452948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.453909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.454932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.455949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.456923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.457862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.458955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459101 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.459929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.460986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.461909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.462841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.463949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.464951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.465898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.466964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.467935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.468951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.469928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.470932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.471992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.472936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.473871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.474964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.475929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.476930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.477875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.478851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.479010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.479093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.479255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.479334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.479485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.485120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.485120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.485331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.485331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.486906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.487916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.488987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.489981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.490915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.491999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.492925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.493896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.494981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.495957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496313 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.496900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.497958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.498898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.499883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.500904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501383 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.501996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502202 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 17:55:24.502685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:55:24.502685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 17:55:24.528815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.528981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.529049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.529192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.529279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.529429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.538861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.539075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.566945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.567175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.567442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.567676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.620639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.621446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.673655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.673879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.674022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.674260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.740440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.740599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.740682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.740761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.740841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.740918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.741010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.741090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.741211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.741299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.741425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.741519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.764949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.765878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.766005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.766098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.766216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.766301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.766431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.777587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.777940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.792537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.792786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.792889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.792959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.793913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.794020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:55:24.811143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.811354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:55:24.811606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.811691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.811820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:55:24.811904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:55:24.812118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.812200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.812340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:55:24.812423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.812607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.812690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.812854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.812935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.813108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.813360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.824297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.824572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.824838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.824927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.825112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.825195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.825429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.825705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.833965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.834147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.837247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.837462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.837561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.837744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.837828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.838946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.839868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.840042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.840124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.840307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.867311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.867865 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.868903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.869177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.869481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.869756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.874409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.874677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.874952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.875058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.875336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.875627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.882723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.883024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.883673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.883954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.887720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.887971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.888250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.888529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.888612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.888798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.888882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.889900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.890170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.890439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.908798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.909065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.909623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.909900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.913569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.914425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.917163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.917455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.918046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.918341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.922392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.923414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.926106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.927060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.929819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.930111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.930392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.930673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.930759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.930950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.931079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.931247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.931365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.931742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.931930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.932208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.950607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.950972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.951519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.951775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.952206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.952579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.952857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.953122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.960297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.961656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.961995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.962268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.963402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.963678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.965325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.965603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.965892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.966166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.966437 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.966734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.967043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.967335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.967615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.967892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.980011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.980286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.980560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.980832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.981106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.981318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:24.981422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.981596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.981695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.981873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.982154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.982434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.982713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.983010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:24.999832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.001792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.003666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.005107 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.006957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.008450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.008564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.010063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.010168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.010490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.010708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.011714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.011988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.012278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.018733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.020321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.020416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.021927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.023542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.023827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.024117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.024391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.025180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.025469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.025759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.026033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.033593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.033879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.034155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.035335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.035636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.035918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.042092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.042370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.042650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.042960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.043224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.043488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.043764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.043846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:55:25.044035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.044925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.045912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.046180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.046464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.046727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.047006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.047284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:55:25.085776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dd014119c0 pid: 80415 (default app) May 04 17:55:25.087607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dd014119c0 pid: 80416 (default app) May 04 17:55:25.089205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f743d-89c9-4337-ba5b-921792e71f8c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:25.089499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f743d-89c9-4337-ba5b-921792e71f8c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:25.089775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f743d-89c9-4337-ba5b-921792e71f8c None None] PATH_INFO: `/v3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:25.093924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Wed May 4 17:55:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:34.075315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab86d6-3d92-4e30-8e0c-a1450bb30691 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:34.076152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab86d6-3d92-4e30-8e0c-a1450bb30691 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:34.076152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab86d6-3d92-4e30-8e0c-a1450bb30691 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:34.080473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:34.085691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:34.086128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:34.086249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:34.117061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG oslo_db.sqlalchemy.engines [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 17:55:34.304468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG passlib.handlers.bcrypt [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80415) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 17:55:34.304880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG passlib.handlers.bcrypt [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80415) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 17:55:34.360457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:34.362020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:34.485616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 17:55:34.634498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab86d6-3d92-4e30-8e0c-a1450bb30691 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:34.668167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG oslo_db.sqlalchemy.engines [None req-a5ab86d6-3d92-4e30-8e0c-a1450bb30691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 17:55:34.795377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab86d6-3d92-4e30-8e0c-a1450bb30691 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:34.799670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:34.800328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:34.800611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:34.800883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:34.808798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:34.860770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 17:55:34.861099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b941a-3af8-4b74-9192-dd5f7bcfaf6a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:34.870669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Wed May 4 17:55:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 17:55:34.876999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:34.891546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafed4b-e93d-4294-946f-72ee9423ba39 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:34.896353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:34.897440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:34.897730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:34.898020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] PATH_INFO: `/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:34.899541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] RBAC: Authorizing `identity:get_project(project_id=90e6c823fef84e7e88dc9cd3e45439fa)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:34.950139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 17:55:34.950480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6531-cf65-4663-8c28-cd1cee359a39 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:34.955961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Wed May 4 17:55:34 2022] GET /identity/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:37.200057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea551-0283-4458-91aa-ab975a9444ec None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:37.200840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea551-0283-4458-91aa-ab975a9444ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:37.200926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea551-0283-4458-91aa-ab975a9444ec None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:37.205652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:55:37.211514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:37.211907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:37.212078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:37.232972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:37.234495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:37.242851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 17:55:37.266824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea551-0283-4458-91aa-ab975a9444ec None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:37.278691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea551-0283-4458-91aa-ab975a9444ec None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:37.283556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6650f-6099-4498-a341-d7d0e4375b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:37.284195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6650f-6099-4498-a341-d7d0e4375b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:37.284482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6650f-6099-4498-a341-d7d0e4375b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:37.284756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6650f-6099-4498-a341-d7d0e4375b66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:37.292368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6650f-6099-4498-a341-d7d0e4375b66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:37.294151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6650f-6099-4498-a341-d7d0e4375b66 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:37.302852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Wed May 4 17:55:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:55:37.308438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:37.317378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0d0de-4d0f-4cf8-aa42-c519d5e73a69 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:37.321759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db462c-0a5c-48e6-8c20-a203a83dfcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:37.322617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db462c-0a5c-48e6-8c20-a203a83dfcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:37.322906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db462c-0a5c-48e6-8c20-a203a83dfcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:37.323221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db462c-0a5c-48e6-8c20-a203a83dfcf6 admin admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:37.324605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db462c-0a5c-48e6-8c20-a203a83dfcf6 admin admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:37.326689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db462c-0a5c-48e6-8c20-a203a83dfcf6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:37.328816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Wed May 4 17:55:37 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:39.651701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b6da0-49ba-475f-a89d-4e48fc3de93d None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:39.652247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b6da0-49ba-475f-a89d-4e48fc3de93d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:39.652247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b6da0-49ba-475f-a89d-4e48fc3de93d None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:39.653617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:39.658903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:39.659365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:39.659509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:39.664513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e66d3-f1ca-4710-959d-71f3375ecf85 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:39.664801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e66d3-f1ca-4710-959d-71f3375ecf85 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:39.665080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e66d3-f1ca-4710-959d-71f3375ecf85 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:39.666402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:55:39.671560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:39.672350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:39.672635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:39.715071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG passlib.handlers.bcrypt [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80416) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 17:55:39.715491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG passlib.handlers.bcrypt [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80416) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 17:55:39.763109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:39.764745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:39.784849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:39.786041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:39.865645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:39.866123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:55:39.887632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:39.888566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:39.983804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc295a6-0334-4ea3-b4ba-52176a463df8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:39.984936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b28ba-088f-43a7-9902-ec6e61b849d2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.016454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.017033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.017238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.017542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.017822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.018088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.018377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.018659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.030264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:40.042061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:40.043119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:55:40.044050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 8/14] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:55:40.049327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:40.083554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.085020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.145032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01c197-742e-4287-851d-c09ea2723b4c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.177122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.177782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.178068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.178347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.178796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:55:40.179128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:40.179437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.180884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.184354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:40.194709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 9/16] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:40.200261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:40.287345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198852c5-002f-4686-827b-8fbbbbcc2030 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.323495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.324314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.324606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.324890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.337179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.338697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:55:40.361362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:40.362253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:40.363094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:55:40.363094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:55:40.363094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:55:40.363094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:55:40.363094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:55:40.368276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:40.406789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672cf4-df94-487d-bd8c-6dfbb14bc30c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.439091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.439964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.440249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.440525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.442056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.443542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.445156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:40 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:40.450834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:40.468365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aa1a5-ae04-40c7-81da-87144ee7635e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.501925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.502591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.502880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.503192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.503917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:40.504226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.505627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.523546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:40.549950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658818-306a-43d5-8062-8b4946422db2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.586427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f2273-e279-4aad-bb74-f141176d65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.587286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2273-e279-4aad-bb74-f141176d65d2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.587567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2273-e279-4aad-bb74-f141176d65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.587844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2273-e279-4aad-bb74-f141176d65d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.589114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2273-e279-4aad-bb74-f141176d65d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.590606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2273-e279-4aad-bb74-f141176d65d2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.592505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:40.599126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:40.702537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9f69-cfdc-4a2b-9e8f-27d75de0e82f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:40.736267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:40.736930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:40.737214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:40.737488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:40.738313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.domain.id=default, user.id=82e6f4474fb345569c3125e43d1dc621) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:40.738623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:40.740124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89c12-281b-4617-87d2-0fd35a67ec32 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:40.746811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1322 bytes} [Wed May 4 17:55:40 2022] GET /identity/v3/role_assignments?user.id=82e6f4474fb345569c3125e43d1dc621&scope.domain.id=default&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:43.102571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ea5b-a271-456f-a35b-d6609429ea8f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.103667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ea5b-a271-456f-a35b-d6609429ea8f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.104163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ea5b-a271-456f-a35b-d6609429ea8f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.106058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:55:43.111910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.112770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.113260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.144927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:43.146464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:43.242507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 04 17:55:43.277840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ea5b-a271-456f-a35b-d6609429ea8f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:43.396748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ea5b-a271-456f-a35b-d6609429ea8f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:43.442534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:43.443817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.444302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.444819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.465529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:43.467380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:55:43.487764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:43.488642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:43.489426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:55:43.489426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:55:43.489426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:55:43.489426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:55:43.491964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 13/24] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:43.498261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:43.608876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940f53-2f5e-4e45-ac4c-44ba805052db None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:43.650133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:43.651192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.651677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.652167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.653095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:43.653609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:43.655248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2aa51-0e5d-41cb-a26b-b9147f4fe2bf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:43.672793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 12/25] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:43.678563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:43.705012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fec53-f54a-4761-8d97-78a852ed6b12 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.705629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fec53-f54a-4761-8d97-78a852ed6b12 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.706125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fec53-f54a-4761-8d97-78a852ed6b12 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.707775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 13/26] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:55:43.713268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091651a2-ea1a-405d-a313-778797911359 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.713844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091651a2-ea1a-405d-a313-778797911359 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.714318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091651a2-ea1a-405d-a313-778797911359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.743620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-091651a2-ea1a-405d-a313-778797911359 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:43.747162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-091651a2-ea1a-405d-a313-778797911359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:43.872323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b8b3-59b7-4e90-876b-86ca7db22bb9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:43.912878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:43.920603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5016f-8941-4fbb-b208-727a129966f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:43.922151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5016f-8941-4fbb-b208-727a129966f9 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:43.922927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5016f-8941-4fbb-b208-727a129966f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:43.923477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5016f-8941-4fbb-b208-727a129966f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:43.924410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5016f-8941-4fbb-b208-727a129966f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:43.926086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5016f-8941-4fbb-b208-727a129966f9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:43.955159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091651a2-ea1a-405d-a313-778797911359 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:44.083277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091651a2-ea1a-405d-a313-778797911359 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:44.161110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:44.161870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.162105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.162382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.163270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:44.164675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:44.199865 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 14/28] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:55:43 2022] POST /identity/v3/projects => generated 301 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:44.202647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcbf7a-71f5-49a1-958a-6124a199df13 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.203799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcbf7a-71f5-49a1-958a-6124a199df13 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.204318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcbf7a-71f5-49a1-958a-6124a199df13 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.208699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:44.214576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceef7b-bcad-49d2-b10e-8a4e4791e9f7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.215206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceef7b-bcad-49d2-b10e-8a4e4791e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.215775 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceef7b-bcad-49d2-b10e-8a4e4791e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.245231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-26ceef7b-bcad-49d2-b10e-8a4e4791e9f7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:44.247286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-26ceef7b-bcad-49d2-b10e-8a4e4791e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:44.388536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 16/30] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:44.390085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469373e-391f-4d4b-b756-6b7cbaf134e8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.390394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469373e-391f-4d4b-b756-6b7cbaf134e8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.390907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469373e-391f-4d4b-b756-6b7cbaf134e8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.392747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 17/31] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:44.398278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.398573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.398864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.433382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:44.433382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:44.433605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 15/32] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 17:55:43 2022] POST /identity/v3/roles => generated 219 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:55:44.433834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:44.560234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43f64-ac55-4939-ab6b-dc4fe400cd80 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:44.589942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:55:44.614796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:44.615689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.615983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.616270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.642085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:44.652168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:44.653071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:44.654238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:55:44.654981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:44.655078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 16/34] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:44.660067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:44.773092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105619-86bb-4954-a79a-7e75ba5f7284 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:44.805324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f8c00-c232-4e6e-9509-d68ddc6c0776 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:44.819925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:44.820619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.820904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.821164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.821925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:44.822238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:44.823879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa66cb6-da6d-4164-878d-2382671ad90b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:44.837401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 17/35] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:44.838827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367dd8-3fce-48b5-81c6-f1e6b948447e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.839165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367dd8-3fce-48b5-81c6-f1e6b948447e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.839430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367dd8-3fce-48b5-81c6-f1e6b948447e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.840680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:44.841747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a304-93c2-42cd-99b4-e3d421db2f9d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.842053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a304-93c2-42cd-99b4-e3d421db2f9d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.842301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a304-93c2-42cd-99b4-e3d421db2f9d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.843684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 19/37] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:44.844407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a304-93c2-42cd-99b4-e3d421db2f9d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:44.851907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc1b78-9776-4553-bf2e-f3188a3e4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:44.852578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1b78-9776-4553-bf2e-f3188a3e4acf None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.852863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1b78-9776-4553-bf2e-f3188a3e4acf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.853143 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1b78-9776-4553-bf2e-f3188a3e4acf None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.853888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc1b78-9776-4553-bf2e-f3188a3e4acf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:44.855454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc1b78-9776-4553-bf2e-f3188a3e4acf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:44.945595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a304-93c2-42cd-99b4-e3d421db2f9d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:44.961730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 19/38] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 17:55:44 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:44.963112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.963454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.963735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.981929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74b7c-96f8-4fb9-9d14-988b92c56adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:44.982256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:44.983055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74b7c-96f8-4fb9-9d14-988b92c56adb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.983234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74b7c-96f8-4fb9-9d14-988b92c56adb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.983490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74b7c-96f8-4fb9-9d14-988b92c56adb None admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:44.983714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:44.985554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74b7c-96f8-4fb9-9d14-988b92c56adb None admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:44.987139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74b7c-96f8-4fb9-9d14-988b92c56adb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:44.989334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 20/39] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:44 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:44.990735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:44.991049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:44.991329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:45.010282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:45.011873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:45.066467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:45.067782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:45.098933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:45.100251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:45.196269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c44a2-4a66-4abe-ba6d-5cbeb7f0c0b8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:45.228700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950ad65-3fc8-4885-92a3-1b476d6a1f96 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:45.233207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:45.234273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:45.234606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:45.234880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:45.236111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:45.237568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:45.239236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 21/42] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:45.240003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:45.264617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:45.266023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:45.266494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:45.266785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:45.268010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:45.269484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:45.271294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:45.271888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:45.341261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe271f4-a1d0-4375-8da3-3c1129cf4f87 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:45.369924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfde3b-4236-4a3b-997a-36f47d7fa4b8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:45.374247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:45.375488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:45.375819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:45.382613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:45.382613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:45.382613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:45.404089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab84ec-5189-4dab-8e70-c91434c8af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:45.404963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab84ec-5189-4dab-8e70-c91434c8af4d None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:45.415449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab84ec-5189-4dab-8e70-c91434c8af4d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:45.415449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab84ec-5189-4dab-8e70-c91434c8af4d None admin] PATH_INFO: `/v3/domains/default/users/82e6f4474fb345569c3125e43d1dc621/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:45.415449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab84ec-5189-4dab-8e70-c91434c8af4d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=82e6f4474fb345569c3125e43d1dc621, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:45.415449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab84ec-5189-4dab-8e70-c91434c8af4d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:45.498816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 17:55:45 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:45.500368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:45.534514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 23/45] 10.222.0.23 () {58 vars in 1361 bytes} [Wed May 4 17:55:45 2022] PUT /identity/v3/domains/default/users/82e6f4474fb345569c3125e43d1dc621/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:45.623226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c8c9-0f88-42ee-9679-7db8eba3315c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:45.663631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cccaab-4fa9-4f99-9f38-583045926840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:45.664337 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cccaab-4fa9-4f99-9f38-583045926840 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:45.664631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cccaab-4fa9-4f99-9f38-583045926840 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:45.664917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cccaab-4fa9-4f99-9f38-583045926840 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:45.665731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cccaab-4fa9-4f99-9f38-583045926840 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:45.667241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cccaab-4fa9-4f99-9f38-583045926840 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:45.758418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:55:45 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:47.811014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffaf3a-b496-4587-89c9-75433bacf924 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:47.811556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffaf3a-b496-4587-89c9-75433bacf924 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:47.811652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffaf3a-b496-4587-89c9-75433bacf924 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:47.813227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:47.819329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5558-72eb-4c38-80a5-aa31495ad0ec None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:47.819858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5558-72eb-4c38-80a5-aa31495ad0ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:47.819944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5558-72eb-4c38-80a5-aa31495ad0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:47.838966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-853a5558-72eb-4c38-80a5-aa31495ad0ec None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:47.840252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-853a5558-72eb-4c38-80a5-aa31495ad0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:47.908216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:47.931607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffaf3a-b496-4587-89c9-75433bacf924 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.007936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6131-ec2d-49e8-bc12-4a2f2bd3bf7d None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.008226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6131-ec2d-49e8-bc12-4a2f2bd3bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.008510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6131-ec2d-49e8-bc12-4a2f2bd3bf7d None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.009890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 25/49] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:55:48.014622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.014947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.015266 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.032559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:48.033347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffaf3a-b496-4587-89c9-75433bacf924 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.033745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:48.066271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.067019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.067316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.067597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.078337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:48.086038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:48.086873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:55:48.087837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:55:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:48.093442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.099048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 26/51] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:55:48.121858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.192499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68c8b-196a-436e-b298-ba2a64d3fd6f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.219625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77ac7-8abb-46d3-a03e-f94d4619c3a7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.228386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.229067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.229364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.229646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.230402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:48.230717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:48.232153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:48.241327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 26/52] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:48.246807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.254628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.255461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.255752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.256024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.257199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:48.258656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:48.260361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:48.265841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.348453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083baa-9074-474a-ad7b-e8ea78bae2ce None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.364646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f89b9-55d4-4a64-8283-a589a217600d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.380325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.381194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.381480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.381758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.387880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:48.387880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:48.387880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:48 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:48.392116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.397697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026569d-a8b1-4cb3-96cd-2c4a3f55a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.398446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026569d-a8b1-4cb3-96cd-2c4a3f55a607 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.398798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026569d-a8b1-4cb3-96cd-2c4a3f55a607 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.399194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026569d-a8b1-4cb3-96cd-2c4a3f55a607 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.399932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026569d-a8b1-4cb3-96cd-2c4a3f55a607 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:48.401371 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026569d-a8b1-4cb3-96cd-2c4a3f55a607 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:48.488509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752b20e-4203-4c7d-8b37-065950d82466 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.523492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.524284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.524576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.524860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.526050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:48.527552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:48.529215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:48.539378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 28/56] 10.222.0.23 () {60 vars in 1140 bytes} [Wed May 4 17:55:48 2022] POST /identity/v3/projects => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:55:48.539562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:48.645522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0e22d-a7a8-4a20-8386-9353e3c3d83f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:48.680628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:48.681307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:48.681598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:48.681881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:48.682733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.domain.id=default, user.id=82e6f4474fb345569c3125e43d1dc621) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:48.683078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:48.684766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d40fe-c5f2-42b0-aa3b-4742d2bcb256 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:48.718617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1322 bytes} [Wed May 4 17:55:48 2022] GET /identity/v3/role_assignments?user.id=82e6f4474fb345569c3125e43d1dc621&scope.domain.id=default&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 530 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:50.832288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861dbc-927e-421f-ac8d-88d5d49e9e70 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:50.832846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861dbc-927e-421f-ac8d-88d5d49e9e70 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:50.832846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861dbc-927e-421f-ac8d-88d5d49e9e70 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:50.834264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:50.839784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:50.840220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:50.840353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:50.857657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:50.859136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:50.924680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:50.950071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861dbc-927e-421f-ac8d-88d5d49e9e70 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:51.047594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861dbc-927e-421f-ac8d-88d5d49e9e70 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:51.080950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfda344-0b0a-47c0-9bf9-07a7686c23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:51.081772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda344-0b0a-47c0-9bf9-07a7686c23ba None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:51.082061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda344-0b0a-47c0-9bf9-07a7686c23ba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:51.082386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda344-0b0a-47c0-9bf9-07a7686c23ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:51.083544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfda344-0b0a-47c0-9bf9-07a7686c23ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:51.084991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfda344-0b0a-47c0-9bf9-07a7686c23ba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:51.086622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:51.092258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:51.187515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efdab7-6e1f-402a-a041-ddfb2596f596 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:51.221715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec84c-db62-4b92-9281-99d2f7f7e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:51.222394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec84c-db62-4b92-9281-99d2f7f7e67d None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:51.222680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec84c-db62-4b92-9281-99d2f7f7e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:51.222958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec84c-db62-4b92-9281-99d2f7f7e67d None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:51.223701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bec84c-db62-4b92-9281-99d2f7f7e67d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:51.225160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bec84c-db62-4b92-9281-99d2f7f7e67d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:51.332342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:55:51 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:54.767859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2191-5969-4b21-ba75-42126c3033d2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:54.768365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2191-5969-4b21-ba75-42126c3033d2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:54.768439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2191-5969-4b21-ba75-42126c3033d2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:54.770052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:54.775358 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c998-050a-4c5d-884f-e3e7ace6a336 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:54.775762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c998-050a-4c5d-884f-e3e7ace6a336 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:54.775928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c998-050a-4c5d-884f-e3e7ace6a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:54.799875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7b42c998-050a-4c5d-884f-e3e7ace6a336 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:54.801127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7b42c998-050a-4c5d-884f-e3e7ace6a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:54.889748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:54.923849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2191-5969-4b21-ba75-42126c3033d2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.068087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2191-5969-4b21-ba75-42126c3033d2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.080796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b1c8-3d23-4744-ad29-4705e87947e9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.081431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b1c8-3d23-4744-ad29-4705e87947e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.081933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b1c8-3d23-4744-ad29-4705e87947e9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.083783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 33/64] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:55:55.088482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110779aa-c296-4400-bfb3-55ee10f78641 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.088878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110779aa-c296-4400-bfb3-55ee10f78641 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.089359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110779aa-c296-4400-bfb3-55ee10f78641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.111252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88a7a-7419-4cb1-99aa-1cd13a944014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.112290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88a7a-7419-4cb1-99aa-1cd13a944014 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.112712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88a7a-7419-4cb1-99aa-1cd13a944014 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.113124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88a7a-7419-4cb1-99aa-1cd13a944014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.122280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-110779aa-c296-4400-bfb3-55ee10f78641 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:55.123985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88a7a-7419-4cb1-99aa-1cd13a944014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:55.124401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-110779aa-c296-4400-bfb3-55ee10f78641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-faa88a7a-7419-4cb1-99aa-1cd13a944014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:55.133090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:55.134145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 32/65] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:55.141442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730acc-79a3-427c-824a-ce9f961124da None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.142273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730acc-79a3-427c-824a-ce9f961124da None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.142273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730acc-79a3-427c-824a-ce9f961124da None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.142273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 33/66] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:55.142273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730acc-79a3-427c-824a-ce9f961124da None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.217910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:55.224651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94dd4-3282-4e88-aefa-0515b75d3768 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.225189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94dd4-3282-4e88-aefa-0515b75d3768 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.225660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94dd4-3282-4e88-aefa-0515b75d3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.260705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a4b94dd4-3282-4e88-aefa-0515b75d3768 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:55.262224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4b94dd4-3282-4e88-aefa-0515b75d3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:55.270288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730acc-79a3-427c-824a-ce9f961124da None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.306284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.307234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.307526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.307807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.308568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:55.308881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:55.310260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:55.319154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:55.320239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.337085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 35/69] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:55.347359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fceaea-4c30-4b2f-a74e-15a4fd4f6a8d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.347656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fceaea-4c30-4b2f-a74e-15a4fd4f6a8d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.347939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fceaea-4c30-4b2f-a74e-15a4fd4f6a8d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.353646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 36/70] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:55.353646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fceaea-4c30-4b2f-a74e-15a4fd4f6a8d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.431114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300f30-0f1d-4863-b815-6c2ce9241833 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.450921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fceaea-4c30-4b2f-a74e-15a4fd4f6a8d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.465233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a05cec-fd49-4c3c-a330-827202ef3df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.466027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05cec-fd49-4c3c-a330-827202ef3df8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.466308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05cec-fd49-4c3c-a330-827202ef3df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.466583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05cec-fd49-4c3c-a330-827202ef3df8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.476922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05cec-fd49-4c3c-a330-827202ef3df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:55.484351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.485211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.485498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.485777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d4a05cec-fd49-4c3c-a330-827202ef3df8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:55.486846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:55.487725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:55:55.488614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:55.489426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9846-5c33-4d88-9a5f-a4a7edf2e435 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.489607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9846-5c33-4d88-9a5f-a4a7edf2e435 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.489892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9846-5c33-4d88-9a5f-a4a7edf2e435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.503225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:55.504709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:55.505791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ddfe9846-5c33-4d88-9a5f-a4a7edf2e435 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:55.506447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:55.506997 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ddfe9846-5c33-4d88-9a5f-a4a7edf2e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:55.507245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.572529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 36/73] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:55.573928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70a37d-9275-4a23-9227-243d66ef92f3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.574231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70a37d-9275-4a23-9227-243d66ef92f3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.574771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70a37d-9275-4a23-9227-243d66ef92f3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.576223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 37/74] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:55.576933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70a37d-9275-4a23-9227-243d66ef92f3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.604594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9203b8-9267-4310-9709-444c9a999893 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.639582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.640385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.640670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.640947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.650827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:55.659404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:55.660293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:55:55.661054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:55.661687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.681534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70a37d-9275-4a23-9227-243d66ef92f3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.714782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.715504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.715795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.716087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.716843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:55.717156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:55.719504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9018-78dc-4131-8fcd-2173c56f4a86 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:55.727548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:55.728771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.729067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.729378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.745578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:55.746754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:55.759894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c1d9-270a-49bc-b64b-917630640cc1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.792176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.792828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.793112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.793391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.810300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 39/77] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:55:55.823534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.873450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:55.875669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:55.909420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46868bd-8910-44be-8bab-c5612bbc681b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.944193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.945001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.945294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.945575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.956821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:55.964621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:55.966041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 40/78] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:55.968057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.972741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:55:55.973600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.068221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f578f-cbd4-4a2d-bdf0-e1192ed7d803 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.073149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192830-8abe-495b-b89e-ab7f2007714c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.100239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.101033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.101321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.101599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.102780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.104260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.105893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 40/80] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.106649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.110627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.111341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.111626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.111908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.112675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:56.113052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.114427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.122478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 41/81] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.123327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.207109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369f273-9cb8-4757-8ca3-b3171f298d85 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.222109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd127-5e55-4e88-bfd4-c0fbac5436c0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.241302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.242105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.242386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.242659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.243848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.245300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.246936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 41/82] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.247691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.259478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.260196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.260439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.260719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.261533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:56.261775 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.263263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.272357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 42/83] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.273193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.347193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8033d69-1300-4d71-a20f-c567ccfcb623 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.368991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5a4f-0725-4036-a0a8-ab89eca47fa1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.379905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.380762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.381049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.381324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.382505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.383989 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.385697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 42/84] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.386473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.401334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.401982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.402271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.402551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.471219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.472700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.486074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6d4e-ab90-4259-bb2e-b1fb5edf9908 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.520187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.521053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.521339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.521613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.522790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.524265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.525893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 43/85] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.526637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.569129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 43/86] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:55:56.569988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.627901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136dbfe-97fe-4560-86f5-183c4e05c88d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.661118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.661797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.662088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.662375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.663122 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.664584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.667065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323fa0-d18a-4743-ac3c-2c66ee7192ab None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.701622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.702622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.702909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.703226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.704417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.705913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.707582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.708350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.771750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 44/88] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:55:56 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:56.772589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.809842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24f19-f5b4-4965-8d6c-2079fad9ba0f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.848132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.848904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.849154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.849445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.850336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=3cf21c9a897f4aadb9b2821d0a1b9b58) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:56.850658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.852206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.867322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/role_assignments?user.id=3cf21c9a897f4aadb9b2821d0a1b9b58&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:56.867322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.896970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8466-7925-43a7-bafd-382b98ee21c9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.937548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.938232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.938523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.938802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.987784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aec8f-2153-4bd6-abbd-973087695146 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.016769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.018312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.034738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.035653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.036576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.036576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.038444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.039962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.042077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 46/90] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:57.042906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.127641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 45/91] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:55:57.128529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.162225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631eccf-0d3b-4568-af2e-91879327fe81 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.215841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.216814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.217884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.218364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.237078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f45b6-1a2e-4781-9e27-5c8ba25c1400 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.276132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.276840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.277124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.277398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.278243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=82e6f4474fb345569c3125e43d1dc621) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:57.278553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.280651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.288118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 46/92] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/role_assignments?user.id=82e6f4474fb345569c3125e43d1dc621&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:57.289324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.299738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.301588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.416726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633cb8-d131-4e38-aac8-6f22762739d6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.503406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.504285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.504569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.504845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.512302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.514649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.517181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 47/93] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:57.520936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 47/94] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:55:57.523056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.539026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.664967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43722b-3039-4cbe-ae2b-303df43a7e4a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.711573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.712162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.712446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.712721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.713560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] RBAC: Adding query filter params (role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=3cf21c9a897f4aadb9b2821d0a1b9b58) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:57.713869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.715349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.730370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 48/95] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/role_assignments?user.id=3cf21c9a897f4aadb9b2821d0a1b9b58&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=db67dafa9e0248e284336b939235ff8e => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:57.767577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e909c-bc69-4df7-93bf-e702c6e1c3dd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.808210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dea9d-7c41-4380-86eb-81c0b01d0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.809098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dea9d-7c41-4380-86eb-81c0b01d0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.809386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dea9d-7c41-4380-86eb-81c0b01d0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.809663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dea9d-7c41-4380-86eb-81c0b01d0ea7 None admin] PATH_INFO: `/v3/projects/80e6770e2523426e966b890b74ba392a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.815887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dea9d-7c41-4380-86eb-81c0b01d0ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=80e6770e2523426e966b890b74ba392a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.817579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dea9d-7c41-4380-86eb-81c0b01d0ea7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.819674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/projects/80e6770e2523426e966b890b74ba392a => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:57.825844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.932816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1453e-08c6-45f2-9106-f2c02d33ec2a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.974336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.974949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.975264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.975542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.976390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=80e6770e2523426e966b890b74ba392a, user.id=3cf21c9a897f4aadb9b2821d0a1b9b58) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:57.976705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.978166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f626-f0ce-4be3-be91-de755d697ff7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.984487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/role_assignments?user.id=3cf21c9a897f4aadb9b2821d0a1b9b58&scope.project.id=80e6770e2523426e966b890b74ba392a&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:59.561022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d308e6-4c82-4481-8ca7-a39b386e1a1a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.561553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d308e6-4c82-4481-8ca7-a39b386e1a1a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.561553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d308e6-4c82-4481-8ca7-a39b386e1a1a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.563325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 49/98] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:55:59.568625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.569061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.569237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.593801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:59.595014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:59.681071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 50/99] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:55:59.715938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d308e6-4c82-4481-8ca7-a39b386e1a1a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.847750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d308e6-4c82-4481-8ca7-a39b386e1a1a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.890031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.890876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.891189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.891496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.905718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:55:59.913233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:55:59.914133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:55:59.914966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 50/100] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:55:59.922200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:00.024942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b07b-75ae-4c24-a5dd-7eab1f9a2ff6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:00.064842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:00.065532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.065819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.066097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.066851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:00.067210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:00.068560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:00.078565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 51/101] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:00.084341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:00.193644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0a27a-fe82-4bf2-97f8-9564b19e8ac6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:00.239717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:00.240612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.240900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.241312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.242428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:00.243928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:00.245986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:00 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:00.252971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:00.357381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf8fd2-20c2-4aa1-be1d-69d5ab981f0c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:00.397028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636431-2382-46f4-835b-72b8981ad8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:00.397974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636431-2382-46f4-835b-72b8981ad8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.398265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636431-2382-46f4-835b-72b8981ad8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.398542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636431-2382-46f4-835b-72b8981ad8a2 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.399812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47636431-2382-46f4-835b-72b8981ad8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:00.401280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47636431-2382-46f4-835b-72b8981ad8a2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:00.403190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:00 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:00.409852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:00.523449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf102be-db06-41fc-bbae-22b77ec1566b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.523745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf102be-db06-41fc-bbae-22b77ec1566b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.523923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf102be-db06-41fc-bbae-22b77ec1566b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.525344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 53/104] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:00.535952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.536536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.536825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.568011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:00.569183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:00.620311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425f847-a2cc-4d86-9bb8-df349e6b2b8c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:00.675749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:00.677156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.677561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 54/105] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:00.677873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.678359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/3cf21c9a897f4aadb9b2821d0a1b9b58/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.680701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] RBAC: Authorizing `identity:create_grant(project_id=c022bdbf7b8c43b18889186e9f4dc4ff, user_id=3cf21c9a897f4aadb9b2821d0a1b9b58, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:00.682395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:00.718247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:00.757361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 52/106] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:00 2022] PUT /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/3cf21c9a897f4aadb9b2821d0a1b9b58/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:00.843601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5bf27-6d9e-46be-a631-c23c67dd5a6e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:00.886877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8113bc-7a9d-4d29-a9f2-f57803d6d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:00.887752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8113bc-7a9d-4d29-a9f2-f57803d6d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.888037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8113bc-7a9d-4d29-a9f2-f57803d6d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.888315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8113bc-7a9d-4d29-a9f2-f57803d6d6c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.905104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8113bc-7a9d-4d29-a9f2-f57803d6d6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2f8113bc-7a9d-4d29-a9f2-f57803d6d6c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:00.913373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:00.914302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:00.915162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 55/107] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:00.921355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:00.930465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393e624-efb0-4ac3-931d-0687133bb4c1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.930673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393e624-efb0-4ac3-931d-0687133bb4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.930926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393e624-efb0-4ac3-931d-0687133bb4c1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.932334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 56/108] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:00.947013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821bc1-a413-458d-826b-8bbb016b4899 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.947013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821bc1-a413-458d-826b-8bbb016b4899 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.947013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821bc1-a413-458d-826b-8bbb016b4899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.970410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c7821bc1-a413-458d-826b-8bbb016b4899 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:00.971695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c7821bc1-a413-458d-826b-8bbb016b4899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:01.070108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd239-d96f-4e43-9ea3-0e1f6069496f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.085593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 57/109] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:01.087160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf1b8e-5fc0-4ca1-8d4d-cd1e831eb9d7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.087452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf1b8e-5fc0-4ca1-8d4d-cd1e831eb9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.087732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf1b8e-5fc0-4ca1-8d4d-cd1e831eb9d7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.089100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 58/110] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:01.095529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.095804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.099016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.126786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:01.128027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:01.136039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.136724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.137015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.137825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.138600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:01.139500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.140988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.152904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 53/111] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:01.153861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.211208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 59/112] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:01.211940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.280771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce245b-581b-4830-aeb5-531c2ed4df86 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.324333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.325656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.326118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.327092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.328967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.330976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.333866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 54/113] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:01.335472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.337074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739be16-a602-4186-8b4e-b44904fd20be None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.374499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861dff7-d265-42ee-a0c7-45298cf57ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.375738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861dff7-d265-42ee-a0c7-45298cf57ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.376283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861dff7-d265-42ee-a0c7-45298cf57ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.376782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861dff7-d265-42ee-a0c7-45298cf57ba7 None admin] PATH_INFO: `/v3/users/0b43d9c748904ebc9ccd34fa59c60bde` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.396438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861dff7-d265-42ee-a0c7-45298cf57ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=0b43d9c748904ebc9ccd34fa59c60bde)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.405702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861dff7-d265-42ee-a0c7-45298cf57ba7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.405702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 60/114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/users/0b43d9c748904ebc9ccd34fa59c60bde => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:01.405702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aaf45-b7f8-4708-9aa5-0b1cd1772e87 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.405702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aaf45-b7f8-4708-9aa5-0b1cd1772e87 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.405702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aaf45-b7f8-4708-9aa5-0b1cd1772e87 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.406246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 61/115] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:01.408030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aaf45-b7f8-4708-9aa5-0b1cd1772e87 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.469319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e2bae-308e-4ddf-abf2-c2b063870757 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.505562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.506387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.506707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.507042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.518643 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:01.526645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:01.527561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:01.528312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:01.535556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 55/116] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:01.536548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.551016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aaf45-b7f8-4708-9aa5-0b1cd1772e87 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.590401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40247ff-47e5-4fd3-ac41-98a68a0d9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.591950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40247ff-47e5-4fd3-ac41-98a68a0d9e95 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.592445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40247ff-47e5-4fd3-ac41-98a68a0d9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.592926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40247ff-47e5-4fd3-ac41-98a68a0d9e95 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.593831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40247ff-47e5-4fd3-ac41-98a68a0d9e95 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.595514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40247ff-47e5-4fd3-ac41-98a68a0d9e95 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.645559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33792-c623-4d5b-9239-208322020ce5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.679232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286041-f147-4d37-b2bd-c7528fa20ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.679877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286041-f147-4d37-b2bd-c7528fa20ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.680162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286041-f147-4d37-b2bd-c7528fa20ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.680441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286041-f147-4d37-b2bd-c7528fa20ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.688408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 62/117] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:56:01 2022] POST /identity/v3/projects => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:01.690135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.690660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.691175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.711520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:01.713104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:01.775869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72286041-f147-4d37-b2bd-c7528fa20ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.777662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72286041-f147-4d37-b2bd-c7528fa20ec0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.797582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 63/118] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:01.798944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.915602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29ecd1-9b76-496a-aa43-997e3b03b307 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.915768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 56/119] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:01.915768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0193d8-b4b2-4449-88b7-da6fc8f967fc None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.915768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0193d8-b4b2-4449-88b7-da6fc8f967fc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.915768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0193d8-b4b2-4449-88b7-da6fc8f967fc None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.916421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 57/120] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:01.918513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0193d8-b4b2-4449-88b7-da6fc8f967fc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.960589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.961277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.961565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.961845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.962606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:01.962920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.964382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.975875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 64/121] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:01.976559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.038073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0193d8-b4b2-4449-88b7-da6fc8f967fc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.081949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772cc0-d049-437e-b431-fadd76bb8b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.083095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772cc0-d049-437e-b431-fadd76bb8b4c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.083385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772cc0-d049-437e-b431-fadd76bb8b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.083662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772cc0-d049-437e-b431-fadd76bb8b4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.086278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff6dc-5238-430b-9c18-02171ced789f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.096296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a772cc0-d049-437e-b431-fadd76bb8b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-5a772cc0-d049-437e-b431-fadd76bb8b4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:02.106158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:02.107072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:02.108919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 58/122] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:02.109711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.109711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.109835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.128489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.129840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.130044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:02.130597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.131127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.131347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:02.132829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.134718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.136918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 65/123] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.138008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.219959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 59/124] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:02.223778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.267225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ee9a-9439-4633-8877-794d47ebbfdf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.304209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.305557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.306064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.306543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.308002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.309667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.312460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 66/125] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.313474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.346024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dea9a3-35d1-407d-b79c-a0084c776bb6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.389496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.390270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.390557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.390835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.391639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:02.391950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.393391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.401986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 60/126] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.402887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.426196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7347-d359-4581-95bd-478a01dd4300 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.461683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.462716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.463284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.463770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.464853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] RBAC: Adding query filter params (role.id=b8480fdf468c47c6ac29a741fafb616e, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=0b43d9c748904ebc9ccd34fa59c60bde) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:02.465374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.467790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.474516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 67/127] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/role_assignments?user.id=0b43d9c748904ebc9ccd34fa59c60bde&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=b8480fdf468c47c6ac29a741fafb616e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.475679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.517560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39f550-1557-415c-9a1f-0fb3610d5f76 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.572138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.572954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.573239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.573512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.593856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:02.594250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416799c-9784-4e53-9d81-b94f48830180 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:02.602064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:02.602978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:02.603783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 61/128] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:02.611562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.699855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.700748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.701123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.701412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.702748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.704290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.706228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 68/129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.708739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.731379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf347be-d61e-479d-8fde-706a860bcb97 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.768460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.769381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.769689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.769941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.771179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.772693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.774704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 62/130] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.775591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.879359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b87da-0a98-410c-92d0-201bfba9fe19 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.913618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.914507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.914790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.915118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/82e6f4474fb345569c3125e43d1dc621/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.917334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c022bdbf7b8c43b18889186e9f4dc4ff, user_id=82e6f4474fb345569c3125e43d1dc621, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.923012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.934207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a826b0-16d7-48e1-87ed-4bff4701c5d7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.970673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.971732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.972223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.972728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.973742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:02.974300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.976150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.986457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 69/131] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:02.986873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.022026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 63/132] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:02 2022] PUT /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/82e6f4474fb345569c3125e43d1dc621/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:03.022669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.165163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2f5b7-dacf-4383-9710-1a4d5d754395 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.260837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.261627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.261907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.262184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] PATH_INFO: `/v3/projects/80e6770e2523426e966b890b74ba392a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.267971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] RBAC: Authorizing `identity:get_project(project_id=80e6770e2523426e966b890b74ba392a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:03.269497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:03.271406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 70/133] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:02 2022] GET /identity/v3/projects/80e6770e2523426e966b890b74ba392a => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:03.273488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd1eea-d4c4-479c-9a07-48c16c3dedf7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.277320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.345255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.346144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.346431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.346710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.347959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:03.349431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:03.359249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 64/134] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:03 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:03.364992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.385744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6a55b-87fb-43ab-8c2d-9a102f65b910 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.421615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.422520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.422801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.423117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] PATH_INFO: `/v3/projects/80e6770e2523426e966b890b74ba392a/users/3cf21c9a897f4aadb9b2821d0a1b9b58/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.425196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e6770e2523426e966b890b74ba392a, user_id=3cf21c9a897f4aadb9b2821d0a1b9b58, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:03.426656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:03.500329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 71/135] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:03 2022] PUT /identity/v3/projects/80e6770e2523426e966b890b74ba392a/users/3cf21c9a897f4aadb9b2821d0a1b9b58/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:03.508734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b79a-6950-4aef-b378-ce11469940dc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.548731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4b32e-026a-428c-9056-ae4d1d5e918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.549625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4b32e-026a-428c-9056-ae4d1d5e918e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.549910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4b32e-026a-428c-9056-ae4d1d5e918e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.550165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4b32e-026a-428c-9056-ae4d1d5e918e None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.551509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4b32e-026a-428c-9056-ae4d1d5e918e None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:03.552971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4b32e-026a-428c-9056-ae4d1d5e918e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:03.554930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 65/136] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:03 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:03.561742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.593633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a17ea-3802-4ecf-8668-c21683c874d0 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.594013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a17ea-3802-4ecf-8668-c21683c874d0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.594282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a17ea-3802-4ecf-8668-c21683c874d0 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.596138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 66/137] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:03.602364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.602655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.602939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.634709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:03.636093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:03.752010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 67/138] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:03.792599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.799175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed02b8-c0a4-4354-b0ea-4d7d855656f6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.855997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.857861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.858573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.859222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/3cf21c9a897f4aadb9b2821d0a1b9b58/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.861780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] RBAC: Authorizing `identity:create_grant(project_id=c022bdbf7b8c43b18889186e9f4dc4ff, user_id=3cf21c9a897f4aadb9b2821d0a1b9b58, role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:03.863499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:03.932058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:03 2022] PUT /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/3cf21c9a897f4aadb9b2821d0a1b9b58/roles/db67dafa9e0248e284336b939235ff8e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:03.950341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108cbce-1f8d-4052-947a-3a8d30c31500 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.990617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.991931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.992422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.992985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.005076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:04.013607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:04.014856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:04.015659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:04.018165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 68/140] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:04.024382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.152340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6baa7b-a944-4800-bd61-203fa6bb602d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.205368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.206554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.207105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.207588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.208569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:04.209094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.210735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.221103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 73/141] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:04.226719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.340962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dd5da-ec66-4055-bdf7-722d0581b59b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.379820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.380718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.381013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.381297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.382555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.384053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.386012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 69/142] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:04.393021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.515230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26bdd6-183b-4531-8802-590bfa31a6ce None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.554110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f555697-7f85-4d3d-8b20-698180286e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.554773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f555697-7f85-4d3d-8b20-698180286e54 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.555097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f555697-7f85-4d3d-8b20-698180286e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.555382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f555697-7f85-4d3d-8b20-698180286e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.639604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f555697-7f85-4d3d-8b20-698180286e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.641446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f555697-7f85-4d3d-8b20-698180286e54 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.758261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 74/143] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:04.764657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.890953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922b2c6-5c8f-4cee-aade-dc0cb4f14840 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.911637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db292c-6d2b-435a-9727-be33cfdb50a5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.912154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db292c-6d2b-435a-9727-be33cfdb50a5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.912229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db292c-6d2b-435a-9727-be33cfdb50a5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.913568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 75/144] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:04.924191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.924488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.924773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.946072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:04.947293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:04.970692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.971606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.971894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.972178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.975257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.976717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.978455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 70/145] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:04.988308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.125725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 76/146] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:05.141284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368e64-8bf0-4e5c-b3dc-cbbaa389edf0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.172059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.221572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.222573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.223075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.223547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.224598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=3cf21c9a897f4aadb9b2821d0a1b9b58) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:05.225120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.227598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.241702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 71/147] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/role_assignments?user.id=3cf21c9a897f4aadb9b2821d0a1b9b58&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:05.339125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aa42-b619-4717-9851-def1b826e832 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.384895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b41d8-cb90-422c-9521-5ebbad9f6210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.389056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b41d8-cb90-422c-9521-5ebbad9f6210 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.389056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b41d8-cb90-422c-9521-5ebbad9f6210 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.389056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b41d8-cb90-422c-9521-5ebbad9f6210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.390384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b41d8-cb90-422c-9521-5ebbad9f6210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.392151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b41d8-cb90-422c-9521-5ebbad9f6210 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.394089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 77/148] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:05.399574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.526964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8c723-dbd3-4dec-8650-56192829b2d0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.565934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c566c7-307b-4d4c-b6a5-bfeab25f9cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.566627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c566c7-307b-4d4c-b6a5-bfeab25f9cdc None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.566917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c566c7-307b-4d4c-b6a5-bfeab25f9cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.567232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c566c7-307b-4d4c-b6a5-bfeab25f9cdc None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.567957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c566c7-307b-4d4c-b6a5-bfeab25f9cdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.569421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c566c7-307b-4d4c-b6a5-bfeab25f9cdc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.695397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 72/149] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:05 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:06.017759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d02a3a-2c44-457d-b149-435b94afc894 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.018709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d02a3a-2c44-457d-b149-435b94afc894 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.019221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d02a3a-2c44-457d-b149-435b94afc894 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.021006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 78/150] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:06.027192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad376-4e8a-4449-8757-e01db385ab73 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.027641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad376-4e8a-4449-8757-e01db385ab73 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.027825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad376-4e8a-4449-8757-e01db385ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.046773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-830ad376-4e8a-4449-8757-e01db385ab73 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:06.048065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-830ad376-4e8a-4449-8757-e01db385ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:06.133249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 73/151] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:06.156296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d02a3a-2c44-457d-b149-435b94afc894 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.269245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d30f-73b2-4271-9f82-588f0be058b3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.269537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d30f-73b2-4271-9f82-588f0be058b3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.269747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d30f-73b2-4271-9f82-588f0be058b3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.271488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 74/152] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:06.274002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d02a3a-2c44-457d-b149-435b94afc894 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.286833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.287470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.287952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.309760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:06.312180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:06.321839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.322725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.322951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.323284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.337112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:06.348118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:06.349106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:06.349866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:06.352577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:06.359519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.400743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 75/154] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:06.427006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.473244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66510c2-e0c3-4e2c-93fe-5fa715482270 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.509111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.509794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.510083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.510364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.511199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:06.511512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:06.512916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:06.522468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:06.529657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.541794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28e626-e0f7-40a1-b940-eeae34547d76 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.581890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.583097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.583610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.584095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.596409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:06.604729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:06.605622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:06.606379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:06.609850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 76/156] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:06.615937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.639932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ab0c-355d-4bdf-9dc6-c639e9411e56 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.675459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.676718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.677226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.677703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] PATH_INFO: `/v3/users/0b43d9c748904ebc9ccd34fa59c60bde` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.679152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] RBAC: Authorizing `identity:get_user(user_id=0b43d9c748904ebc9ccd34fa59c60bde)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:06.680854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:06.682747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 81/157] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/users/0b43d9c748904ebc9ccd34fa59c60bde => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:06.688346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.726520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d7800-a554-415d-baec-46b58b4fafa0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.762932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.764233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.764897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.765401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.766395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:06.766895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:06.768464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:06.777559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 77/158] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:06.784033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.796614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9b0e6-9b04-49f3-b43a-9a678707ecb1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.832550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.833426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.833711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.833989 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.835248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:06.836733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:06.838578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 82/159] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:06.849291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.897184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218bb06-511d-4ff7-b4cf-122f0fad27d0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.932769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.934020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.934533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.935571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] PATH_INFO: `/v3/users/82e6f4474fb345569c3125e43d1dc621` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.937418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] RBAC: Authorizing `identity:get_user(user_id=82e6f4474fb345569c3125e43d1dc621)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:06.939116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:06.941019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 78/160] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/users/82e6f4474fb345569c3125e43d1dc621 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:06.946733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.960126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70045c-43ea-43a2-842f-229d25bb709b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:07.000108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7524d-d267-40ac-a921-590896c22434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:07.001021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7524d-d267-40ac-a921-590896c22434 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.001353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7524d-d267-40ac-a921-590896c22434 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.001640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7524d-d267-40ac-a921-590896c22434 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/0b43d9c748904ebc9ccd34fa59c60bde/roles/b8480fdf468c47c6ac29a741fafb616e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.003727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7524d-d267-40ac-a921-590896c22434 None admin] RBAC: Authorizing `identity:create_grant(project_id=c022bdbf7b8c43b18889186e9f4dc4ff, user_id=0b43d9c748904ebc9ccd34fa59c60bde, role_id=b8480fdf468c47c6ac29a741fafb616e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:07.005201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7524d-d267-40ac-a921-590896c22434 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:07.066744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630e99c-00f4-4904-827f-c5f399f102e7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:07.092321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 83/161] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:06 2022] PUT /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/users/0b43d9c748904ebc9ccd34fa59c60bde/roles/b8480fdf468c47c6ac29a741fafb616e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:07.113239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:07.114330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.114817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.115326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.193776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:07.195772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:07.197449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fb8c5-4156-4f8a-abda-0406555e20fc None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.197748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fb8c5-4156-4f8a-abda-0406555e20fc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.198033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fb8c5-4156-4f8a-abda-0406555e20fc None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.200609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 84/162] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:07.217160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b988a7-b045-46d3-8813-4dc8c5c3bc77 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.217492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b988a7-b045-46d3-8813-4dc8c5c3bc77 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.217715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b988a7-b045-46d3-8813-4dc8c5c3bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.264689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40b988a7-b045-46d3-8813-4dc8c5c3bc77 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:07.265929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40b988a7-b045-46d3-8813-4dc8c5c3bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:07.312776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 79/163] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:56:07.318431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:07.415600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 85/164] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:07.419015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069a31-2530-4f40-b37d-d2086059ba85 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.419015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069a31-2530-4f40-b37d-d2086059ba85 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.419015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069a31-2530-4f40-b37d-d2086059ba85 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.419273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 86/165] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:07.427794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.428084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.428560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.449055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceda40-b2d2-4aba-8f3e-247496803bcd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:07.456934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:07.458436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:07.527615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 87/166] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:07.529459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:07.531746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:07.532679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.532970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.533243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.538120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:07.539946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:07.541960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 80/167] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:07 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:07.548593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:07.631917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9a77-7eb4-420c-b1d7-0cce7ce9a4e3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:07.667472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:07.668662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.669193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.670490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.682644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:07.691217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:07.692307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:07.693163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:07.695281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 88/168] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:07.696289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:07.758872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd8ccf-3ff6-42d2-a543-55ac050c4541 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:07.801509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9771-5296-4905-bdfc-e31b5844dc4d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:07.832240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:07.832926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.833213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.833491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.834336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=82e6f4474fb345569c3125e43d1dc621) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:07.834653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:07.836136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:07.837957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:07.838999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:07.839496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:07.839956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:07.851723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 81/169] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:07 2022] GET /identity/v3/role_assignments?user.id=82e6f4474fb345569c3125e43d1dc621&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:07.852462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:07.852584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:07.865890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:07.866815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:07.867617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:07.870347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 89/170] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:07.876946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:08.069391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4de37b-adf3-4e4f-933a-1739c5ff7b71 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:08.083455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836974ff-21aa-4933-9614-c9ea6f5fffb3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:08.141871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:08.142555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:08.142844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:08.143155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:08.143924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:08.144236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:08.145796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:08.153023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:08.153765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:08.154056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:08.154913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:08.156145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:08.156462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:08.157873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:08.166356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 90/171] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:08.170072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 82/172] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:08.175960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:08.179749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:08.344089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3378f-296d-4fc1-802b-6fca45a766f2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:08.364608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e8df8-0774-40a8-a157-29cb48d1fc6c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:08.383853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:08.386512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:08.386512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:08.386512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:08.388535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:08.390032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:08.392020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 91/173] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:08 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:08.399025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:08.449098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:08.449978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:08.450257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:08.451005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] PATH_INFO: `/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:08.452972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf21c9a897f4aadb9b2821d0a1b9b58)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:08.454445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:08.460807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 83/174] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:08 2022] GET /identity/v3/users/3cf21c9a897f4aadb9b2821d0a1b9b58 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:08.468391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:08.601587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c90cc-465a-4101-bdcc-008600368bd3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:08.631243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aebf65-b32b-46b0-a535-f6711bc50bb0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:08.648713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:08.649377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:08.649664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:08.649933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:08.679552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:08.680216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:08.680502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:08.680782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:08.742196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:08.743696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:08.772989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:08.774499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:08.844729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 92/175] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:08.850739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:08.880654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 84/176] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:56:08.887213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:09.049025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4cc5f-14ad-4e00-9422-14e305b7a458 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:09.063245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fa3e2-52e5-471a-a375-a70c06a462c1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:09.103703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:09.104574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:09.104859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:09.105138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:09.111735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:09.113199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:09.114916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 93/177] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:08 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:09.118335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:09.119206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:09.119488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:09.119769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] PATH_INFO: `/v3/projects/80e6770e2523426e966b890b74ba392a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:09.120938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] RBAC: Authorizing `identity:get_project(project_id=80e6770e2523426e966b890b74ba392a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:09.123253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:09.126367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:09.128276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 85/178] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:08 2022] GET /identity/v3/projects/80e6770e2523426e966b890b74ba392a => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:09.139159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:09.368918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379de63-525b-4e19-84e0-3c67a9e70d6e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:09.382812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72706-b348-4fae-bcdc-003e7f1c5f8d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:09.439870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:09.440882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:09.441368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:09.441863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:09.442920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] RBAC: Adding query filter params (role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=3cf21c9a897f4aadb9b2821d0a1b9b58) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:09.443473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:09.447990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273de7c8-b279-449c-bf29-ef0b238402a9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:09.460292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 94/179] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:09 2022] GET /identity/v3/role_assignments?user.id=3cf21c9a897f4aadb9b2821d0a1b9b58&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=db67dafa9e0248e284336b939235ff8e => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:09.462869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:09.463558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:09.463843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:09.464117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:09.465049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=80e6770e2523426e966b890b74ba392a, user.id=3cf21c9a897f4aadb9b2821d0a1b9b58) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:09.465363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:09.467725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8715fa-25f9-42d2-97bf-6430bcc16ffc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:09.480461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 86/180] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:09 2022] GET /identity/v3/role_assignments?user.id=3cf21c9a897f4aadb9b2821d0a1b9b58&scope.project.id=80e6770e2523426e966b890b74ba392a&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:10.152710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b23b0-93fc-4b4e-aef0-985e05fc4ac0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.153391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b23b0-93fc-4b4e-aef0-985e05fc4ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.154032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b23b0-93fc-4b4e-aef0-985e05fc4ac0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.155951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 95/181] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:10.161935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a754d-535a-4922-8c24-3a97a7c6916a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.162814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a754d-535a-4922-8c24-3a97a7c6916a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.163324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a754d-535a-4922-8c24-3a97a7c6916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.183504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6e0a754d-535a-4922-8c24-3a97a7c6916a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:10.185672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6e0a754d-535a-4922-8c24-3a97a7c6916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:10.271346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 87/182] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:10.294679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b23b0-93fc-4b4e-aef0-985e05fc4ac0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.331603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9873b-c8a4-4e8e-829b-88c1f3523497 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.331921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9873b-c8a4-4e8e-829b-88c1f3523497 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.332175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9873b-c8a4-4e8e-829b-88c1f3523497 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.333847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 88/183] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:10.340080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.340704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.341326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.362639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:10.363856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:10.416616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b23b0-93fc-4b4e-aef0-985e05fc4ac0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:10.443916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 89/184] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:10.460922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:10.462073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.462588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.464042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.468622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.481238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:10.492592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:10.493714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:10.494696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:10.498531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 96/185] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:10.506945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.577362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53bd5-f859-4ec7-9bdd-41f8ba58cfa8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:10.611397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb1f77-4360-463e-8961-147f23cff85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:10.612347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb1f77-4360-463e-8961-147f23cff85f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.612630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb1f77-4360-463e-8961-147f23cff85f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.612901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb1f77-4360-463e-8961-147f23cff85f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.614464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4fde8-46d5-40fb-9b60-7fcb292b53e5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:10.623442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb1f77-4360-463e-8961-147f23cff85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b1eb1f77-4360-463e-8961-147f23cff85f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:10.632222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:10.633281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 90/186] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:10.634254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03554879-5c23-4b6c-8533-ee4a28173de2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.635182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03554879-5c23-4b6c-8533-ee4a28173de2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.635182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03554879-5c23-4b6c-8533-ee4a28173de2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.636032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 91/187] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:10.636962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d5a78-2f74-4040-b30e-4d5cb34683e8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.637297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d5a78-2f74-4040-b30e-4d5cb34683e8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.637580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d5a78-2f74-4040-b30e-4d5cb34683e8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.639009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 92/188] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:10.643897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b0656-6728-4f29-b82c-3ac1d5cffd34 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.644179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b0656-6728-4f29-b82c-3ac1d5cffd34 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.644454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b0656-6728-4f29-b82c-3ac1d5cffd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.659168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:10.659842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.660126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.660397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.661135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:10.661277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a29b0656-6728-4f29-b82c-3ac1d5cffd34 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:10.661429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:10.662369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a29b0656-6728-4f29-b82c-3ac1d5cffd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:10.662827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:10.671937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 97/189] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:10.672799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.730233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 93/190] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:10.732397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.732696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.732972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.749070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:10.750261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:10.768985 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373af6a-5788-47e1-b759-7f89c28d2d50 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:10.802473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:10.803171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.803458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.803737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.804484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:10.804796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:10.806182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:10.814330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 94/191] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:10.814482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 98/192] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:10.815043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.815141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.916508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914045b8-f7fc-4595-89d0-36d73093cb3c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:10.917683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05922c8-77bf-4c3d-a872-c682badc0196 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:10.949104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:10.949914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.950023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:10.950193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.951023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] PATH_INFO: `/v3/users/5127f3c06d98444f85aa0eb962a668ea` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.951342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:10.951630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:10.951903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:10.961857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:10.965579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] RBAC: Authorizing `identity:get_user(user_id=5127f3c06d98444f85aa0eb962a668ea)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:10.967161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:10.968834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 95/193] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/users/5127f3c06d98444f85aa0eb962a668ea => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:10.969591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:10.969906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:10.970872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 99/194] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:10.976966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.071064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf2542-1e47-401b-aa16-a3545b5fa8bf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.071969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6583-d0b9-498a-b237-2de9ed24db11 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.104657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.105051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.105440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.105721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.105922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.106032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.106203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.106477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] PATH_INFO: `/v3/users/5127f3c06d98444f85aa0eb962a668ea` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.108324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.108457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] RBAC: Authorizing `identity:get_user(user_id=5127f3c06d98444f85aa0eb962a668ea)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.109126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.109417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.110739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 100/195] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:11.111196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:10 2022] GET /identity/v3/users/5127f3c06d98444f85aa0eb962a668ea => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:11.111622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.116186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.209505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaba73-721c-4aa9-9763-c283d8d0ab39 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.218132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351972-2707-4323-b53c-327f2f2be0e2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.242510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.243211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.243483 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.243761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.251232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.251902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.252188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.252474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.253248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:11.253558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.254927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.267586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 97/197] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:11.267586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.309476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.311354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.359352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf3fcf-7ff6-4fde-8f99-3b46e43e79eb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.391305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.391978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.392264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.392541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.393255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.394716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.408350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 101/198] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:11.409208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.507156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 98/199] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:11 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:11.507156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.508077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b73e5-4a68-4c6f-baff-4947558c2270 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.546493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.547272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.547481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.547755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.615230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7736ec-b8f8-4967-8aa2-a0725493f6d4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.622241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.624240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.659153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.660435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.660929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.661417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] PATH_INFO: `/v3/users/0b43d9c748904ebc9ccd34fa59c60bde` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.662893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] RBAC: Authorizing `identity:get_user(user_id=0b43d9c748904ebc9ccd34fa59c60bde)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.664575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.666580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 99/200] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/users/0b43d9c748904ebc9ccd34fa59c60bde => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:11.667670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.732489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 102/201] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:11.733430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.788181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf9834-c3fc-4b60-9a37-5905d66f997f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.829530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.830401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.830694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.830968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.832196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.833634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.835487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 100/202] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:11.836258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.838366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f77c4-9c3c-4499-8c12-5cb0f20d2938 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.875302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.876316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.876829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.877301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.941171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba5f6-2569-4223-8365-a3fb7948fea1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.947986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.949973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.975826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.976697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.977076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.977267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.978497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.980071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.982404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 101/203] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:11.983177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:12.055846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 103/204] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:12.062137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:12.085650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e7a9a-fb97-450a-b8f8-01c3cd02471e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:12.120001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:12.120579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:12.120864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:12.121141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:12.121983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=5127f3c06d98444f85aa0eb962a668ea) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:12.122328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:12.123803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:12.129485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 102/205] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:11 2022] GET /identity/v3/role_assignments?user.id=5127f3c06d98444f85aa0eb962a668ea&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:12.130284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:12.168010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4937d0d-c7a3-44ce-a146-33bb99bbef01 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:12.214191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:12.215299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:12.215785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:12.216993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:12.218043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] RBAC: Adding query filter params (role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=5127f3c06d98444f85aa0eb962a668ea) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:12.218557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:12.220288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:12.226641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 104/206] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:12 2022] GET /identity/v3/role_assignments?user.id=5127f3c06d98444f85aa0eb962a668ea&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=db67dafa9e0248e284336b939235ff8e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:12.242404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadaea2-6943-4a52-a5cc-28214fbebde8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:12.281421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fcc8a-f63d-4d8f-aaad-d41617499fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:12.282340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fcc8a-f63d-4d8f-aaad-d41617499fba None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:12.282626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fcc8a-f63d-4d8f-aaad-d41617499fba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:12.282906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fcc8a-f63d-4d8f-aaad-d41617499fba None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:12.284360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fcc8a-f63d-4d8f-aaad-d41617499fba None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:12.285839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fcc8a-f63d-4d8f-aaad-d41617499fba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:12.287661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 103/207] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:12 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:12.293981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:12.412565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1bf6a-39ec-48f2-8ccc-3b05da15b6ec None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:12.453536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:12.454226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:12.454511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:12.454788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:12.455857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] RBAC: Adding query filter params (role.id=b8480fdf468c47c6ac29a741fafb616e, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff, user.id=0b43d9c748904ebc9ccd34fa59c60bde) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:12.456171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:12.457708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0c66-bf9d-46d3-acd0-24b3994d00eb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:12.464365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 105/208] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:12 2022] GET /identity/v3/role_assignments?user.id=0b43d9c748904ebc9ccd34fa59c60bde&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=b8480fdf468c47c6ac29a741fafb616e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:14.053547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8a40f-2f0e-45d7-b953-7f535588de09 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.054065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8a40f-2f0e-45d7-b953-7f535588de09 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.054143 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8a40f-2f0e-45d7-b953-7f535588de09 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.055810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 104/209] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:14.063062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea0ca-5db6-4479-b31b-b5856a5c4ebb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.063062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea0ca-5db6-4479-b31b-b5856a5c4ebb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.063062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea0ca-5db6-4479-b31b-b5856a5c4ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.084217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8fdea0ca-5db6-4479-b31b-b5856a5c4ebb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:14.085793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8fdea0ca-5db6-4479-b31b-b5856a5c4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:14.167101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:14.188638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8a40f-2f0e-45d7-b953-7f535588de09 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.280486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765630b-4157-4124-b29e-8ab9455474b4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.280841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765630b-4157-4124-b29e-8ab9455474b4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.281054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765630b-4157-4124-b29e-8ab9455474b4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.282724 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 107/211] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:14.288406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.288819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.289212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.301927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8a40f-2f0e-45d7-b953-7f535588de09 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:14.307436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:14.308682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:14.337069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:14.338112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.338538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.338953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.350271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:14.358770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:14.359840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:14.360824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:14.362857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 105/212] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:14.368823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.395009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 108/213] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:14.415187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.503930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb287-3d8f-4d75-ac07-665617bda2aa None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:14.536516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb4695-41f9-482f-ad29-9ae2a590325b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:14.545483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:14.546145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.546429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.546706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.547573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:14.547882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:14.549320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:14.562719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 106/214] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:14.565285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.584426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:14.585228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.585512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.585787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.586956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:14.588671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:14.590395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 109/215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:14.596062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.681971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304593-11f1-43ca-a21f-bcddda8a709a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:14.701883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1681-3f60-4810-a2b4-0d020c243270 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:14.714558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff431b9-b7c7-4254-afa7-e354bdd4b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:14.715466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff431b9-b7c7-4254-afa7-e354bdd4b19b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.716368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff431b9-b7c7-4254-afa7-e354bdd4b19b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.716649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff431b9-b7c7-4254-afa7-e354bdd4b19b None admin] PATH_INFO: `/v3/users/b615475728544dd282b609c57898006d` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.730058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff431b9-b7c7-4254-afa7-e354bdd4b19b None admin] RBAC: Authorizing `identity:get_user(user_id=b615475728544dd282b609c57898006d)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:14.731785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff431b9-b7c7-4254-afa7-e354bdd4b19b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:14.733479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 107/216] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:14 2022] GET /identity/v3/users/b615475728544dd282b609c57898006d => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:14.734702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82ea2-402e-4c0f-af98-474950e422e9 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.735009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82ea2-402e-4c0f-af98-474950e422e9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.735285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82ea2-402e-4c0f-af98-474950e422e9 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.736511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 108/217] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:14.737592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fa48-12e3-4b9d-a084-069f2e6a2296 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.737965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fa48-12e3-4b9d-a084-069f2e6a2296 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.738139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fa48-12e3-4b9d-a084-069f2e6a2296 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.739388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 109/218] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:14.740617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4f58-7553-4585-ad79-3a2f6c9dd344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:14.741471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4f58-7553-4585-ad79-3a2f6c9dd344 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.741757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4f58-7553-4585-ad79-3a2f6c9dd344 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.742032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4f58-7553-4585-ad79-3a2f6c9dd344 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.742748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4f58-7553-4585-ad79-3a2f6c9dd344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:14.743811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000fa48-12e3-4b9d-a084-069f2e6a2296 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.744252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4f58-7553-4585-ad79-3a2f6c9dd344 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:14.839997 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000fa48-12e3-4b9d-a084-069f2e6a2296 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:14.851015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 110/219] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:14 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:56:14.852275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d351e5-adc3-4d3c-8768-9e62ee3e07d8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.852554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d351e5-adc3-4d3c-8768-9e62ee3e07d8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.852841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d351e5-adc3-4d3c-8768-9e62ee3e07d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.871192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-38d351e5-adc3-4d3c-8768-9e62ee3e07d8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:14.872639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-38d351e5-adc3-4d3c-8768-9e62ee3e07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:14.877002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:14.877668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.877948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.878224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.947020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 111/220] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:14.948441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:14.948714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:14.948994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:14.952106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:14.953848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:14.975697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:14.976924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:15.053361 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 112/221] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:15.057080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.059574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 110/222] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:15.071814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.166436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f414-63cb-41d5-b928-7b07a31665bd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.166602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cefc1b-bc19-473f-8937-4e5b20975eff None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.202732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.203916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.203916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.204193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.205626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.208791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.213414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.213659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 111/223] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:15.214249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.214930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.215138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.215138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.233946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:15.243237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:15.244357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:15.245160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:15.247973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 113/224] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:15.249042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.342425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39293096-5c97-4e5e-a192-041afb6e97a0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.357735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ac77-6a95-4787-8bd0-eb02a0885834 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.386528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.388045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.388347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.388626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.394180 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.395559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.395990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.396408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.397387 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=b615475728544dd282b609c57898006d) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:15.397861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.399545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.400087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:15.409270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 114/225] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/role_assignments?user.id=b615475728544dd282b609c57898006d&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:15.415120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:15.415336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:15.416157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:15.417006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 112/226] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:15.424497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.543073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6527-979c-45be-925c-96be91873c7a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.593247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.593935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.594217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.594492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.595283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:15.595588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.596990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.621227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 115/227] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:15.627742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.656363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf6fb-236d-4e72-b44f-1a673d1af9bf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.705551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.706436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.706735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.707037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.707798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:15.708106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.709490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.718617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 113/228] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:15.724530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.818739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b14629-b163-4edb-9d57-a1937d238c4d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.853444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.854389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.854682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.854959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] PATH_INFO: `/v3/users/5127f3c06d98444f85aa0eb962a668ea` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.858689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] RBAC: Authorizing `identity:get_user(user_id=5127f3c06d98444f85aa0eb962a668ea)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.860230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.862118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 116/229] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/users/5127f3c06d98444f85aa0eb962a668ea => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:15.867393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.879591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680cb3-c2dc-4129-9d7e-1b7c141e04f7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.949278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.951158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.951818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.952286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] PATH_INFO: `/v3/users/5127f3c06d98444f85aa0eb962a668ea` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.953718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] RBAC: Authorizing `identity:get_user(user_id=5127f3c06d98444f85aa0eb962a668ea)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.955401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.957317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 114/230] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/users/5127f3c06d98444f85aa0eb962a668ea => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:15.963881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.028829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11dde4-bf1f-4381-b783-de3631515cda None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.100970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.101836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.102118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.102416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.103667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.103945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2aee1-7934-4a2c-a6a9-8651a54d3d56 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.105119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.107487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:16.115945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.139475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.140341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.140624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.140901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.142084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.143669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.145701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 115/232] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:16.151430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.302717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa580088-48c0-46ee-ab78-834afdc936e4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.332960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddffc2e-8aa4-4d1e-a20c-fffeec14ecdc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.375740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234bb99-cd0d-46d5-b6ba-b9342753d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.375740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bb99-cd0d-46d5-b6ba-b9342753d258 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.375740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bb99-cd0d-46d5-b6ba-b9342753d258 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.375740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bb99-cd0d-46d5-b6ba-b9342753d258 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/5127f3c06d98444f85aa0eb962a668ea/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.380543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234bb99-cd0d-46d5-b6ba-b9342753d258 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d946d9407d447aa42596aae92c9dd4, user_id=5127f3c06d98444f85aa0eb962a668ea, role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.382086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234bb99-cd0d-46d5-b6ba-b9342753d258 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.411009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7171e93-a203-4b8a-afe9-172b6725166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.415008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7171e93-a203-4b8a-afe9-172b6725166b None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.415008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7171e93-a203-4b8a-afe9-172b6725166b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.415008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7171e93-a203-4b8a-afe9-172b6725166b None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/5127f3c06d98444f85aa0eb962a668ea/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.415008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7171e93-a203-4b8a-afe9-172b6725166b None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d946d9407d447aa42596aae92c9dd4, user_id=5127f3c06d98444f85aa0eb962a668ea, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.415843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7171e93-a203-4b8a-afe9-172b6725166b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.494100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 118/233] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:16 2022] PUT /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/5127f3c06d98444f85aa0eb962a668ea/roles/db67dafa9e0248e284336b939235ff8e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:16.523114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:16 2022] PUT /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/5127f3c06d98444f85aa0eb962a668ea/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:17.661324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588552-7f3c-4e3b-9d86-96369afbc7df None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.661324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588552-7f3c-4e3b-9d86-96369afbc7df None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.661324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588552-7f3c-4e3b-9d86-96369afbc7df None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.661324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:17.667746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.668735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.669213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.687898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:17.689397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:17.754016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ba55-e429-46f2-a272-b14cc8c5f9c1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.754670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ba55-e429-46f2-a272-b14cc8c5f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.755169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ba55-e429-46f2-a272-b14cc8c5f9c1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.756707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 120/236] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:17.763462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.764244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.764731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.781250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 117/237] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:17.782368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:17.783823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:17.819152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.857757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 121/238] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:17.884429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.002102 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398bd3-f2c4-4406-a3a5-0cc2c0521e90 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.028886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf80dc-52bf-413b-8bbb-40c11eb94ed9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.041799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6761b-f947-4094-b247-30c52f49f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.043746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6761b-f947-4094-b247-30c52f49f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.044387 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6761b-f947-4094-b247-30c52f49f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.045031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6761b-f947-4094-b247-30c52f49f2fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.047179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6761b-f947-4094-b247-30c52f49f2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.049336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6761b-f947-4094-b247-30c52f49f2fa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.051257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 122/239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:18.053271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e8f1-0b5f-49a1-88de-a4d18bd218c0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.053776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e8f1-0b5f-49a1-88de-a4d18bd218c0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.054255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e8f1-0b5f-49a1-88de-a4d18bd218c0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.055776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 123/240] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:18.065863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.066546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.067046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.071423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.072412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.073140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.073585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.086247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:18.086444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:18.087955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:18.094610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:18.095629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:18.096446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 118/241] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:18.097102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.160252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 124/242] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:18.161449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.224556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5f0d0-e0df-4533-bad5-4708c34b6ee5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.264793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.266215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.266650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.267238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.268232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.270346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.287255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b8b3-3196-41ca-97e7-e4548b857ee5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.322177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.323134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.323434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.323701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.324447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:18.324803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.326208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.334923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 125/243] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:18.335622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.379140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 119/244] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:18 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:18.379140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.455723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52e6e3-d25e-4443-aa29-f2944f9f3824 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.513751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09eb69-85ac-45c7-882f-b7500e84e9a3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.532621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.533880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.534369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.534880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.548142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:18.556309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.556937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.557222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.557503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] PATH_INFO: `/v3/users/af81a97fbdaa4c70825ca655325e7997` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:18.559738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:18.560747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:18.561532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:18.569439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 126/245] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:18.573884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] RBAC: Authorizing `identity:get_user(user_id=af81a97fbdaa4c70825ca655325e7997)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.576540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.577247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.578760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 120/246] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/users/af81a97fbdaa4c70825ca655325e7997 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:18.587234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.701685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb627f-6805-4ab4-a12d-7de9c4173a74 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.708756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff886a-ccaa-4ab9-8f72-083e1ea11016 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.738767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.739810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.740313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.740810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.741752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:18.742260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.743947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.745721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.746322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.747189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.747468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.754689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 127/247] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:18.760609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.818371 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.819804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.865870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13c26-41fa-4200-81b4-04233fd01d52 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.901642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.902944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.903476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.903949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] PATH_INFO: `/v3/users/b615475728544dd282b609c57898006d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.905371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] RBAC: Authorizing `identity:get_user(user_id=b615475728544dd282b609c57898006d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.907036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.908888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 128/248] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/users/b615475728544dd282b609c57898006d => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:18.914930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.919642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 121/249] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:18.925390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:19.020774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1e0e6-8c02-4502-913d-c0636e098c2f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.025625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3244a7-0600-4355-90ed-29bd069d0423 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.056334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:19.057562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.058046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.058626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.060740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:19.062735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:19.062847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:19.063644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.063926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.064202 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.065405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:19.065792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 129/250] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:19.068490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:19.069362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 122/251] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:19.072457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:19.075962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:19.180621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528f66b-6c60-4d76-b449-0dddea27afc7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.181873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dda09-3f79-4013-9eab-21df0a6fe0d4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.223866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:19.224222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd394e0-bcd3-4c13-a691-962f73d80aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:19.224534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.224812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.225086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.225366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd394e0-bcd3-4c13-a691-962f73d80aaf None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.225718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd394e0-bcd3-4c13-a691-962f73d80aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.225920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] RBAC: Adding query filter params (role.id=b8480fdf468c47c6ac29a741fafb616e, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=af81a97fbdaa4c70825ca655325e7997) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:19.226077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd394e0-bcd3-4c13-a691-962f73d80aaf None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/b615475728544dd282b609c57898006d/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.226229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:19.227733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b080-81b2-45d4-82c4-2b8f1dc0d788 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:19.228317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd394e0-bcd3-4c13-a691-962f73d80aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d946d9407d447aa42596aae92c9dd4, user_id=b615475728544dd282b609c57898006d, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:19.229839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd394e0-bcd3-4c13-a691-962f73d80aaf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:19.233921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 123/252] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:19 2022] GET /identity/v3/role_assignments?user.id=af81a97fbdaa4c70825ca655325e7997&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=b8480fdf468c47c6ac29a741fafb616e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:19.361156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 130/253] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:19 2022] PUT /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/b615475728544dd282b609c57898006d/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:19.491038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68371a90-97c4-4d18-af20-f998a1d0b599 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.491729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68371a90-97c4-4d18-af20-f998a1d0b599 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.492212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68371a90-97c4-4d18-af20-f998a1d0b599 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.494194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 124/254] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:19.501090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.501718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.502238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.528613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:19.530170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:19.618429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 131/255] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:19.655801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68371a90-97c4-4d18-af20-f998a1d0b599 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:19.791073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68371a90-97c4-4d18-af20-f998a1d0b599 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.826380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765967e-8364-4c07-b28a-8535f0e6c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:19.827215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765967e-8364-4c07-b28a-8535f0e6c50f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.827496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765967e-8364-4c07-b28a-8535f0e6c50f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.827766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765967e-8364-4c07-b28a-8535f0e6c50f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.839490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765967e-8364-4c07-b28a-8535f0e6c50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d765967e-8364-4c07-b28a-8535f0e6c50f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:19.848329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:19.849331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:19.850136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 125/256] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:19.857575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:19.981598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a92ee-c3c9-45a7-85e6-8c20342c479e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.991510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b0b8-6510-4e00-ba96-a632680df64a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.991798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b0b8-6510-4e00-ba96-a632680df64a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.992079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b0b8-6510-4e00-ba96-a632680df64a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.994962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 126/257] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:19.999557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.999851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.000194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.029064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.030133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.030620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.031138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.032199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:20.032707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:20.034297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:20.035983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:20.037228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:20.044551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 132/258] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:20.057443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:20.179945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729797-6ba5-4c7e-8664-c9bc7bbb34ee None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:20.193314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 127/259] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:20.227176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.228415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.228904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.229403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] PATH_INFO: `/v3/users/5127f3c06d98444f85aa0eb962a668ea` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.231547 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] RBAC: Authorizing `identity:get_user(user_id=5127f3c06d98444f85aa0eb962a668ea)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:20.233445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:20.235698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 133/260] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:20 2022] GET /identity/v3/users/5127f3c06d98444f85aa0eb962a668ea => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:20.243033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:20.244314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:20.378632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e10679-a6f9-44a8-9e61-5fb498925a82 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:20.412827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.413627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.413906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.414181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.425712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:20.435953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:20.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:20.437664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 134/261] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:20.444071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:20.472932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c33e1-74e3-41db-9dcf-5ac1e2fedac0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:20.544536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.545212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.545500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.545783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.563845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed75bf-7326-436f-a7c7-2f084ca69db6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:20.601953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.602623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.602903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.603234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.603979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:20.604284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:20.606377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:20.615189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 135/262] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:20.621187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:20.715840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:20.717496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:20.734632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59df44-b94a-4261-a613-f369a5de4da1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:20.772927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.773820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.774102 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.774372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] PATH_INFO: `/v3/users/5127f3c06d98444f85aa0eb962a668ea` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.775682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] RBAC: Authorizing `identity:get_user(user_id=5127f3c06d98444f85aa0eb962a668ea)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:20.777521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:20.779636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 136/263] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:20 2022] GET /identity/v3/users/5127f3c06d98444f85aa0eb962a668ea => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:20.785707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:20.909208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477b9bf-bcf5-4684-a384-05153964c0ec None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:20.950733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:20.955474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:20.955764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:20.956401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:20.996965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:21.005301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:21.140943 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:21.142477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:21.183559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c557e-da11-4e4b-aff8-d7d1281290be None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:21.229661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:21.230534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:21.231111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:21.231404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:21.232631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:21.234068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:21.235859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 129/265] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:21 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:21.244117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:21.427012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 137/266] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:56:21.429299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:21.447192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd457-b4a0-4115-a16d-d3dc106e51c1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:21.520870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:21.521994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:21.522276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:21.522549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:21.523885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] RBAC: Adding query filter params (role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=5127f3c06d98444f85aa0eb962a668ea) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:21.524203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:21.525650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:21.538354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 130/267] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:21 2022] GET /identity/v3/role_assignments?user.id=5127f3c06d98444f85aa0eb962a668ea&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=db67dafa9e0248e284336b939235ff8e => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:21.624724 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd545c-cdf7-4efd-b52e-4b564a652751 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:21.667577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d0fc6-ce43-4244-9bca-dbd5c600f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:21.668571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d0fc6-ce43-4244-9bca-dbd5c600f544 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:21.668977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d0fc6-ce43-4244-9bca-dbd5c600f544 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:21.669155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d0fc6-ce43-4244-9bca-dbd5c600f544 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:21.670529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d0fc6-ce43-4244-9bca-dbd5c600f544 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:21.672032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d0fc6-ce43-4244-9bca-dbd5c600f544 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:21.674056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 138/268] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:21 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:21.679826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:21.820409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c6e8-c148-4507-b335-8b5a185dc6f2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:21.863211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:21.863895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:21.864176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:21.864452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:21.865289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=5127f3c06d98444f85aa0eb962a668ea) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:21.865599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:21.867047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c4937-2e72-4a2a-8ab1-3ca59dc09e35 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:21.874286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 131/269] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:21 2022] GET /identity/v3/role_assignments?user.id=5127f3c06d98444f85aa0eb962a668ea&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:22.331904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e410-014a-4d8d-b2d0-6fbecd9218b1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.332398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e410-014a-4d8d-b2d0-6fbecd9218b1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.332474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e410-014a-4d8d-b2d0-6fbecd9218b1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.334127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 139/270] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:22.339195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc6f5-c90a-4359-98ca-1c9eb123373f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.339650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc6f5-c90a-4359-98ca-1c9eb123373f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.339734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc6f5-c90a-4359-98ca-1c9eb123373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.366321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-347bc6f5-c90a-4359-98ca-1c9eb123373f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:22.367578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-347bc6f5-c90a-4359-98ca-1c9eb123373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:22.457043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 132/271] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:22.480654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e410-014a-4d8d-b2d0-6fbecd9218b1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:22.496932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95444d16-8c15-46c1-9e6f-401452b6bd3d None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.497250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95444d16-8c15-46c1-9e6f-401452b6bd3d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.497491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95444d16-8c15-46c1-9e6f-401452b6bd3d None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.499098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 133/272] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:22.506176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb4c8-5790-4ecf-90c6-534b7937b8aa None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.506786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb4c8-5790-4ecf-90c6-534b7937b8aa None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.507295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb4c8-5790-4ecf-90c6-534b7937b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.531332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1b3eb4c8-5790-4ecf-90c6-534b7937b8aa None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:22.532839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1b3eb4c8-5790-4ecf-90c6-534b7937b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:22.602801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e410-014a-4d8d-b2d0-6fbecd9218b1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:22.606569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 134/273] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:22.610805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea760b27-2c77-4990-b6a6-1861a82aee48 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.610805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea760b27-2c77-4990-b6a6-1861a82aee48 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.610805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea760b27-2c77-4990-b6a6-1861a82aee48 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.610805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 135/274] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:22.615202 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920176c-d104-448d-bc58-b634137012bd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.615494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920176c-d104-448d-bc58-b634137012bd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.615775 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920176c-d104-448d-bc58-b634137012bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.633426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f920176c-d104-448d-bc58-b634137012bd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:22.634632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f920176c-d104-448d-bc58-b634137012bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:22.641676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:22.642546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.642834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.643136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.654908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:22.662767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:22.663693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:22.664474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 140/275] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:22.665128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:22.709814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 136/276] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:22.710466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920176c-d104-448d-bc58-b634137012bd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:22.764226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd07f5f-7f6e-4abe-a896-5a66b2ad2293 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:22.795871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe7486-aa25-411c-84de-ea88c5e65a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:22.796664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe7486-aa25-411c-84de-ea88c5e65a30 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.796942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe7486-aa25-411c-84de-ea88c5e65a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.797213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe7486-aa25-411c-84de-ea88c5e65a30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.804666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920176c-d104-448d-bc58-b634137012bd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:22.806885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe7486-aa25-411c-84de-ea88c5e65a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-affe7486-aa25-411c-84de-ea88c5e65a30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:22.814952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:22.815826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:22.816651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 141/277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:22.817895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dbc9-289b-4405-91ca-3a233e22a0e2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.817895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dbc9-289b-4405-91ca-3a233e22a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.817895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dbc9-289b-4405-91ca-3a233e22a0e2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.819110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 142/278] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:22.821140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022dbc9-289b-4405-91ca-3a233e22a0e2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:22.839298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:22.840124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.840410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.840872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.841619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:22.841924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:22.843352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:22.851359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 137/279] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:22.851989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:22.919796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022dbc9-289b-4405-91ca-3a233e22a0e2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:22.946581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3b2c0-c870-4894-939b-f88332c0cd98 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:22.951924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914a226-2af1-4ed6-bd8b-8bc926c77c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:22.952712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a226-2af1-4ed6-bd8b-8bc926c77c18 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.952991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a226-2af1-4ed6-bd8b-8bc926c77c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.953263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a226-2af1-4ed6-bd8b-8bc926c77c18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.954396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914a226-2af1-4ed6-bd8b-8bc926c77c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:22.955876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914a226-2af1-4ed6-bd8b-8bc926c77c18 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:22.957466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 143/280] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:22.958598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.958864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.959166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.977367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:22.978324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:22.978446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:22.978981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:22.979282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:22.979557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:22.980289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:22.981109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:22.982548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:22.990560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 138/281] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:22.991204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.047234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 144/282] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:23.048156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.094868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a314f6-fca4-43e6-b2f3-f2468606a570 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.127645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.128513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.128798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.129074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] PATH_INFO: `/v3/users/25e292691fca4195a7042ad6b03cd250` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.142111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] RBAC: Authorizing `identity:get_user(user_id=25e292691fca4195a7042ad6b03cd250)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.143555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.145225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 139/283] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:22 2022] GET /identity/v3/users/25e292691fca4195a7042ad6b03cd250 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:23.145854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493200-cdca-48cf-ab28-64c3ebc9c80e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.146024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.181782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.182455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.182741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.183048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.184534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.186202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.242752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f639181-1944-4724-b3d0-219e864d55ba None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.275205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.276063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.276348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.276624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] PATH_INFO: `/v3/users/af81a97fbdaa4c70825ca655325e7997` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.278317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] RBAC: Authorizing `identity:get_user(user_id=af81a97fbdaa4c70825ca655325e7997)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.279856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.281500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/users/af81a97fbdaa4c70825ca655325e7997 => generated 297 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:23.285535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.289607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 145/285] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:23 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:23.290728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.390209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6311ec3-48c7-477f-8899-faac0f92ca6a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.403233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f920e1c-c866-436e-987f-09dabaf74eb5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.431351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.432162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.432450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.432731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.443289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.443972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.444409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.444694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.444790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:23.445601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, user.id=25e292691fca4195a7042ad6b03cd250, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:23.445947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.447879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:23.453133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:23.454087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:23.455409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 141/286] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:23.456522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.465533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/role_assignments?user.id=25e292691fca4195a7042ad6b03cd250&scope.system=all&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:23.465533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.580927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1955-1d79-497b-b2d0-355ea03cbe47 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.591349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd30989-677e-48c2-85e6-3333d5e1f9f4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.628021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.628892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.629174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.629449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.630781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.632437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.634623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:23.641382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.647911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.648828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.649260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.649683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.650627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:23.656207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.658017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.668503 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 147/289] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:23.675035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.764959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769c65a-d9aa-4694-ab6b-eb1114a66217 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.803045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.803942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.804232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.804509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/af81a97fbdaa4c70825ca655325e7997/roles/b8480fdf468c47c6ac29a741fafb616e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.806998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d946d9407d447aa42596aae92c9dd4, user_id=af81a97fbdaa4c70825ca655325e7997, role_id=b8480fdf468c47c6ac29a741fafb616e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.808966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.831987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d2ee-e793-46b9-83d7-8ad4797fbc8f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:23.868922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:23.870036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:23.870322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:23.870602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] PATH_INFO: `/v3/users/b615475728544dd282b609c57898006d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:23.872413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] RBAC: Authorizing `identity:get_user(user_id=b615475728544dd282b609c57898006d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:23.873987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:23.876175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 148/290] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/users/b615475728544dd282b609c57898006d => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:23.884097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:23.905880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:56:23 2022] PUT /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4/users/af81a97fbdaa4c70825ca655325e7997/roles/b8480fdf468c47c6ac29a741fafb616e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:23.996772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e4c32-ec78-4117-93e0-7071ed8744ea None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:24.032932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:24.033665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:24.033947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:24.034221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:24.109241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:24.110642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:24.219156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 149/292] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:24.221472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:24.326012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce531e-60f6-43f4-8898-befe6ec66a0e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:24.360760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f3c28-4ffc-4de7-a8dd-67062519493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:24.361559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3c28-4ffc-4de7-a8dd-67062519493c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:24.361841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3c28-4ffc-4de7-a8dd-67062519493c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:24.362115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3c28-4ffc-4de7-a8dd-67062519493c None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:24.363392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f3c28-4ffc-4de7-a8dd-67062519493c None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:24.364865 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f3c28-4ffc-4de7-a8dd-67062519493c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:24.366868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 144/293] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:24 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:24.372844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:24.474919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47cd5-37e4-4c7b-be79-8f8488935ff2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:24.509302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:24.509965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:24.510244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:24.510517 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:24.511378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=b615475728544dd282b609c57898006d) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:24.512257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:24.513792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c2e0-bd52-4c9e-9073-9430e8c6382f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:24.520149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 150/294] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:24 2022] GET /identity/v3/role_assignments?user.id=b615475728544dd282b609c57898006d&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:25.920532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5641070-a83b-4a8e-ac07-75bd48aebc6e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:25.921054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5641070-a83b-4a8e-ac07-75bd48aebc6e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:25.921054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5641070-a83b-4a8e-ac07-75bd48aebc6e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:25.922696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 145/295] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:25.928328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def90a-f207-4fd2-bd5b-8c6019b018d6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:25.929187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def90a-f207-4fd2-bd5b-8c6019b018d6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:25.929666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def90a-f207-4fd2-bd5b-8c6019b018d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:25.946676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f6def90a-f207-4fd2-bd5b-8c6019b018d6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:25.948507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f6def90a-f207-4fd2-bd5b-8c6019b018d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:26.016774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:26.040322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5641070-a83b-4a8e-ac07-75bd48aebc6e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.051544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816ce1-b6b3-40bd-9f46-e89010a2b04d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.051837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816ce1-b6b3-40bd-9f46-e89010a2b04d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.052108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816ce1-b6b3-40bd-9f46-e89010a2b04d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.053583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 152/297] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:26.059131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2baea1-4cc2-4935-8b81-e57335dfa026 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.059433 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2baea1-4cc2-4935-8b81-e57335dfa026 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.059955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2baea1-4cc2-4935-8b81-e57335dfa026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.077391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6e2baea1-4cc2-4935-8b81-e57335dfa026 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:26.078478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6e2baea1-4cc2-4935-8b81-e57335dfa026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:26.145608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 153/298] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:26.147323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be44d0-2f76-46ff-803f-b9bd45cde387 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.147843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be44d0-2f76-46ff-803f-b9bd45cde387 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.148312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be44d0-2f76-46ff-803f-b9bd45cde387 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.149872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 154/299] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:26.154747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5641070-a83b-4a8e-ac07-75bd48aebc6e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.155748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.156111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.156461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.173736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:26.174822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:26.195492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.196572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.197054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.197755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.212286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:26.221448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:26.222521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:26.223385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:26.223999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 146/300] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:26.224591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.254706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 155/301] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:26.263181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.340005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b8a4c-efe4-48f1-a57b-ff1b230343de None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.357049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2975b2a-a1d9-4b81-84b0-6985e943a99b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.374873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.375700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.375986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.376265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.377437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:26.378874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:26.380688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 147/302] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:26.381283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.396098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.397244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.397722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.398148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.399133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:26.399603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:26.401134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:26.411766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 156/303] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:26.412646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.502267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314809e0-a741-4ff8-9773-36c249f1989f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.514105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56dd36-bdff-49ef-8c61-2898b7d4044e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.537688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.538481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.538777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.539103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.546916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.547611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.547895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.548167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] PATH_INFO: `/v3/groups` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.548838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:26.549568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:26.550276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:26.557240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:26.558162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:26.559387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 148/304] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:26.560098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.624297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 157/305] 10.222.0.23 () {60 vars in 1134 bytes} [Wed May 4 17:56:26 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:26.625162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.670164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8d6a-8dec-4616-b123-9766dde3d864 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.709141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ad4f0-06d9-4e4c-86d5-131186ed349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.710030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad4f0-06d9-4e4c-86d5-131186ed349d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.710308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad4f0-06d9-4e4c-86d5-131186ed349d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.710579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad4f0-06d9-4e4c-86d5-131186ed349d None admin] PATH_INFO: `/v3/users/6f8c8f762821491b872dc4631f1bc25e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.727192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ad4f0-06d9-4e4c-86d5-131186ed349d None admin] RBAC: Authorizing `identity:get_user(user_id=6f8c8f762821491b872dc4631f1bc25e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:26.729057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ad4f0-06d9-4e4c-86d5-131186ed349d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:26.730903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 149/306] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/users/6f8c8f762821491b872dc4631f1bc25e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:26.732242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61848f3e-b7c2-4b2b-8ed2-8ebf76f29ddf None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.732522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61848f3e-b7c2-4b2b-8ed2-8ebf76f29ddf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.732797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61848f3e-b7c2-4b2b-8ed2-8ebf76f29ddf None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.734321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 150/307] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:26.739148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61848f3e-b7c2-4b2b-8ed2-8ebf76f29ddf None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.749087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d602b3-9214-4678-aedb-afdc918b4703 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.785155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.785839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.786120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.786399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.787201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:26.787509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:26.788963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b538bd9-294b-40da-a512-81c626f758b0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:26.797982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 158/308] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:26.799332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.800413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.800413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.818599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:26.819834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:26.863794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61848f3e-b7c2-4b2b-8ed2-8ebf76f29ddf None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:26.898297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 159/309] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:26.899337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:26.904118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:26.904785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:26.905066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:26.905347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:26.906181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] RBAC: Adding query filter params (role.id=b8480fdf468c47c6ac29a741fafb616e, user.id=6f8c8f762821491b872dc4631f1bc25e, scope.system=all) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:26.906550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:26.908083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:26.913299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 151/310] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/role_assignments?user.id=6f8c8f762821491b872dc4631f1bc25e&scope.system=all&role.id=b8480fdf468c47c6ac29a741fafb616e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:26.940127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:27.014138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5f3a1-3fde-4e2e-b722-eac160a1d6da None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.049316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a31d6f-5f0b-4390-983e-d98b3a5dcf14 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.051599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.052710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.053145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.053554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] PATH_INFO: `/v3/users/25e292691fca4195a7042ad6b03cd250` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.054976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] RBAC: Authorizing `identity:get_user(user_id=25e292691fca4195a7042ad6b03cd250)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:27.056689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:27.059478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 160/311] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/users/25e292691fca4195a7042ad6b03cd250 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:27.065339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:27.088235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.089048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.089331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.090238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.101767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:27.109869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:27.111019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:27.111943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:27.116076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 152/312] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:27.117115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:27.191604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff662ed-4c6b-40ac-8e03-2225ec61c2d5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.231443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.232467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.232807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.233159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] PATH_INFO: `/v3/system/users/25e292691fca4195a7042ad6b03cd250/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.234720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=25e292691fca4195a7042ad6b03cd250, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:27.236236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:27.236821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5f35-11ec-406b-82af-9e6781efa6b5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.271813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.272477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.272756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.273025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.273789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:27.274210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:27.275475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:27.285065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 153/313] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:27.290167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:27.343343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 161/314] 10.222.0.23 () {58 vars in 1334 bytes} [Wed May 4 17:56:27 2022] PUT /identity/v3/system/users/25e292691fca4195a7042ad6b03cd250/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:27.398826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d8c5-0b49-4285-bf28-c2297bd417a6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.437794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.438674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.438957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.439260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] PATH_INFO: `/v3/users/af81a97fbdaa4c70825ca655325e7997` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.440509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] RBAC: Authorizing `identity:get_user(user_id=af81a97fbdaa4c70825ca655325e7997)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:27.442011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:27.444053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 154/315] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:27 2022] GET /identity/v3/users/af81a97fbdaa4c70825ca655325e7997 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:27.450610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:27.564020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be546620-21c8-4d94-ab57-cbbbe5240bbe None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.599477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.600351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.600775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.601189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.670630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:27.672430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:27.781557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 162/316] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:27.786924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:27.890882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb01ee-8cc0-4ffd-9b91-28ec2edb1aaa None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:27.924429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7bb4f-afcc-4192-a43c-f8e30f5a2d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:27.925556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7bb4f-afcc-4192-a43c-f8e30f5a2d3f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:27.925977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7bb4f-afcc-4192-a43c-f8e30f5a2d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:27.926390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7bb4f-afcc-4192-a43c-f8e30f5a2d3f None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:27.927730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7bb4f-afcc-4192-a43c-f8e30f5a2d3f None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:27.929316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7bb4f-afcc-4192-a43c-f8e30f5a2d3f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:27.931462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 155/317] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:27 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:27.937915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:28.039494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074be98-36dd-4b9c-920e-013d6283e28d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:28.076029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:28.076703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:28.076991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:28.077269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:28.078109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] RBAC: Adding query filter params (role.id=b8480fdf468c47c6ac29a741fafb616e, scope.project.id=a8d946d9407d447aa42596aae92c9dd4, user.id=af81a97fbdaa4c70825ca655325e7997) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:28.078426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:28.079925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c689c-86f3-496a-8c11-460a9eb7a8be None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:28.087014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 163/318] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:27 2022] GET /identity/v3/role_assignments?user.id=af81a97fbdaa4c70825ca655325e7997&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=b8480fdf468c47c6ac29a741fafb616e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:29.022550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c682de-70bb-4499-869c-df42e6617e7a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.023132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c682de-70bb-4499-869c-df42e6617e7a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.023481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c682de-70bb-4499-869c-df42e6617e7a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.025362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 156/319] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:29.031700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82452e-ecee-42ce-bf1c-3b19501beccb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.032002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82452e-ecee-42ce-bf1c-3b19501beccb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.032289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82452e-ecee-42ce-bf1c-3b19501beccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.051197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ae82452e-ecee-42ce-bf1c-3b19501beccb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:29.052452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ae82452e-ecee-42ce-bf1c-3b19501beccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:29.130098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 164/320] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:29.153205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c682de-70bb-4499-869c-df42e6617e7a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.248802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7511cd-bef9-4dec-a12d-ce908b7d9501 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.249091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7511cd-bef9-4dec-a12d-ce908b7d9501 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.249376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7511cd-bef9-4dec-a12d-ce908b7d9501 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.250744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 165/321] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:29.256071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.256457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.256815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.262482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c682de-70bb-4499-869c-df42e6617e7a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.273700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:29.274815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:29.297062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.297854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.298133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.298404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.299689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:29.301191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:29.302977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 157/322] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:29.308260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.344013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 166/323] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:29.366910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.408041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414bc3-0445-4aed-b288-394e7f5d4aa3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.448474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a70e2-7196-4cb1-9278-386629ebedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.449931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a70e2-7196-4cb1-9278-386629ebedf8 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.450384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a70e2-7196-4cb1-9278-386629ebedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.450669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a70e2-7196-4cb1-9278-386629ebedf8 None admin] PATH_INFO: `/v3/groups` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.451425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a70e2-7196-4cb1-9278-386629ebedf8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:29.452933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a70e2-7196-4cb1-9278-386629ebedf8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:29.474544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474ca92-12d4-422f-8ad8-f46e323116b2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.511045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.512580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.512831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.513151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.523830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:29.532291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:29.533462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 167/324] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:29.539561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.581385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 158/325] 10.222.0.23 () {60 vars in 1134 bytes} [Wed May 4 17:56:29 2022] POST /identity/v3/groups => generated 226 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:56:29.643260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f81ebd-f3f3-4284-8753-ad9bc76b37d3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.643618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f81ebd-f3f3-4284-8753-ad9bc76b37d3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.643887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f81ebd-f3f3-4284-8753-ad9bc76b37d3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.645331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 159/326] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:29.649917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723537b-6ca3-4b9e-9c24-c14b43531ae7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.651144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.651432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.651710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.669789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:29.671032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:29.686603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.687390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.687670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.687950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.688705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:29.689009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:29.690421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:29.705055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 168/327] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:29.707397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.752520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 160/328] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:29.770113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.816505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064863-78c8-4daa-979c-a9199ceadd0c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.851908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.853214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.853702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.854175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] PATH_INFO: `/v3/users/6f8c8f762821491b872dc4631f1bc25e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.857496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f8c8f762821491b872dc4631f1bc25e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:29.859208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:29.861042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 169/329] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/users/6f8c8f762821491b872dc4631f1bc25e => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:29.866581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.884505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538c375-3fba-4e1f-9e7b-ef32b6a62daa None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.925737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.926540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.926820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.927127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.940113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:29.949611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:29.950738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:29.951636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 161/330] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:29.956642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.975129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4cf5-272c-4427-b915-fafa4b1bbeb7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.012012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.014080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.014080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.014080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] PATH_INFO: `/v3/system/users/6f8c8f762821491b872dc4631f1bc25e/roles/b8480fdf468c47c6ac29a741fafb616e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.015642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6f8c8f762821491b872dc4631f1bc25e, role_id=b8480fdf468c47c6ac29a741fafb616e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.017106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.071178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebdfc-3620-458a-a401-c6f5d9ab2ba7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.086515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 170/331] 10.222.0.23 () {58 vars in 1334 bytes} [Wed May 4 17:56:29 2022] PUT /identity/v3/system/users/6f8c8f762821491b872dc4631f1bc25e/roles/b8480fdf468c47c6ac29a741fafb616e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:30.110584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.111305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.111635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.111917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.112696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:30.113001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.114446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.125607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 162/332] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:30.131176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:30.253780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d4d2-5b19-4344-9024-a6611ab2cff9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.291065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76924d5c-7e59-4bbf-9e74-70bb09c659d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.291956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76924d5c-7e59-4bbf-9e74-70bb09c659d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.292240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76924d5c-7e59-4bbf-9e74-70bb09c659d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.292751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76924d5c-7e59-4bbf-9e74-70bb09c659d5 None admin] PATH_INFO: `/v3/users/25e292691fca4195a7042ad6b03cd250` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.294193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76924d5c-7e59-4bbf-9e74-70bb09c659d5 None admin] RBAC: Authorizing `identity:get_user(user_id=25e292691fca4195a7042ad6b03cd250)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.295697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76924d5c-7e59-4bbf-9e74-70bb09c659d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.297689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 171/333] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:30 2022] GET /identity/v3/users/25e292691fca4195a7042ad6b03cd250 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:30.304415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:30.437072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0173a-75d7-478e-8a74-05935584dd57 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.476018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.476682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.476966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.477235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.478065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] RBAC: Adding query filter params (role.id=d5d4fe9c418e4d439e1de3e11ed84d07, user.id=25e292691fca4195a7042ad6b03cd250, scope.system=all) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:30.478375 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.480322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1687-ef2f-4034-a63b-06946f4900eb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.498680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 163/334] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 17:56:30 2022] GET /identity/v3/role_assignments?user.id=25e292691fca4195a7042ad6b03cd250&scope.system=all&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:32.631758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3ba3-e318-4490-98e5-c1a89045c688 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:32.632289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3ba3-e318-4490-98e5-c1a89045c688 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:32.632289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3ba3-e318-4490-98e5-c1a89045c688 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:32.633984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 172/335] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:32.640486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:32.640942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:32.641036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:32.664047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:32.665247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:32.676767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd277-1048-4bfb-b1f8-3b1caee70ede None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:32.677081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd277-1048-4bfb-b1f8-3b1caee70ede None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:32.677334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadd277-1048-4bfb-b1f8-3b1caee70ede None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:32.678959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 173/336] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:32.685353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:32.685661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:32.685907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:32.712662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:32.714949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:32.779469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 164/337] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:32.814841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:32.816117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 174/338] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:32.874701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.010949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b55ae5-52a8-4fa1-980f-52b378b28613 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.021356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256a9b-fc7c-4557-9e8f-065640229e09 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.061622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.062452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.062734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.063023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.084454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.085262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.085541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.085813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.086832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:33.095548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:33.096458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:33.097272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 175/339] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:33.112064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.113595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:33.123573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:33.124506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:33.125319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 165/340] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:33.148949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.231847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75f02-b771-43c5-9a66-5514a6d774f3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.273987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.274583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.274867 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.276132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.276132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:33.276326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.278543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1977c01-5a0a-4ab0-985a-4cd323f3430e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.287215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 176/341] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:33.288532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860f718-3d31-4392-a436-0edafebc2dd1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.288825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860f718-3d31-4392-a436-0edafebc2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.289106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860f718-3d31-4392-a436-0edafebc2dd1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.290598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 177/342] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:33.299273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860f718-3d31-4392-a436-0edafebc2dd1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.339265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2ffb-5ef7-464c-a4b8-e6005c0b6198 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.382976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.387897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.387897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.387897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.387897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:33.387897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.387897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2005-9e46-486c-809f-49e90d1bb034 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.406336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 166/343] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:33.407989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.408523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.409035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.441308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:33.443484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:33.444314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860f718-3d31-4392-a436-0edafebc2dd1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.521884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.522940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.523462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.523931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.584706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 167/344] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:33.587015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.655449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.656998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.705749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f03b5-42fc-4ec8-945a-4b395e27b252 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.744119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.745181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.745668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.746177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.766651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 178/345] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:33.767828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.817571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.819293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.875113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25e88-5d80-4557-a635-6c939695c7c5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.915706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3fc48-3eab-4397-8043-e3478282d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.916858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3fc48-3eab-4397-8043-e3478282d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.917473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3fc48-3eab-4397-8043-e3478282d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.917964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3fc48-3eab-4397-8043-e3478282d0a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.924993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 168/346] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:33.926147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.931871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3fc48-3eab-4397-8043-e3478282d0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-11e3fc48-3eab-4397-8043-e3478282d0a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:33.940938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:33.942044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:56:33.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:33.945450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 179/347] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:33.947343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed42aea-c31f-4eae-8386-7aff8e60bf9b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.947804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed42aea-c31f-4eae-8386-7aff8e60bf9b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.948297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed42aea-c31f-4eae-8386-7aff8e60bf9b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.951033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 180/348] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:33.952034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed42aea-c31f-4eae-8386-7aff8e60bf9b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.030027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92462f-3dc0-4de2-88e7-4f09936f6e73 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.064951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed42aea-c31f-4eae-8386-7aff8e60bf9b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.067711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.068673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.068960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.069232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.072514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.074015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.076296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 169/349] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.077079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.108177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde9422-09cb-42ec-a121-9423eb91d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.109330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9422-09cb-42ec-a121-9423eb91d26b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.109617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9422-09cb-42ec-a121-9423eb91d26b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.110048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9422-09cb-42ec-a121-9423eb91d26b None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.112117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde9422-09cb-42ec-a121-9423eb91d26b None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.113592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde9422-09cb-42ec-a121-9423eb91d26b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.116702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 181/350] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.117952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0e5a-c1ea-4fff-ba70-6283b354560d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.118245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0e5a-c1ea-4fff-ba70-6283b354560d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.118526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0e5a-c1ea-4fff-ba70-6283b354560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.143853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3d1c0e5a-c1ea-4fff-ba70-6283b354560d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:34.145062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d1c0e5a-c1ea-4fff-ba70-6283b354560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:34.198105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bfe48-cd1e-4f4d-8bfc-1caf9eba923a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.238732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.238953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 182/351] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:34.239923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.240273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed83f8b-721b-4771-8660-e683af550ff8 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.240563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed83f8b-721b-4771-8660-e683af550ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.240837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed83f8b-721b-4771-8660-e683af550ff8 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.241021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.241476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.242079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 183/352] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:34.242634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:34.242800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed83f8b-721b-4771-8660-e683af550ff8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.243488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.249060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.258419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 170/353] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.259590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.370947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed83f8b-721b-4771-8660-e683af550ff8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.381402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7690c-4c2a-43be-a2b6-a6350b7f9950 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.423190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca17c7-22f1-4997-8dc1-bf71597e7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.423190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca17c7-22f1-4997-8dc1-bf71597e7c23 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.423190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca17c7-22f1-4997-8dc1-bf71597e7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.423190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca17c7-22f1-4997-8dc1-bf71597e7c23 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.425240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca17c7-22f1-4997-8dc1-bf71597e7c23 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.425521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.426383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.426664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.426756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca17c7-22f1-4997-8dc1-bf71597e7c23 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.426936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.428318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.431936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 184/354] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.432090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.432170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.432170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.432170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.436844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 171/355] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.437802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.449525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:34.451066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:34.544796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 185/356] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:34.551199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.562253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30eacd-37cb-432d-b4fd-ba3e4d98fb71 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.601976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.602857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.603178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.603446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] PATH_INFO: `/v3/users/6f8c8f762821491b872dc4631f1bc25e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.605270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] RBAC: Authorizing `identity:get_user(user_id=6f8c8f762821491b872dc4631f1bc25e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.606919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.609016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 172/357] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/users/6f8c8f762821491b872dc4631f1bc25e => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.609630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.680848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d742e-8a29-4f36-bdb3-94faaa804725 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.718008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.718827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.719198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.719508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae270fa-ab34-40c5-834c-03bcf230ef8c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.719937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.734234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:34.744407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:34.746571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:34.747576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:34.749922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 186/358] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:34.751089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.765208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.766159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.766443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.766720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.767603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:34.767920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.769792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.778591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 173/359] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=db67dafa9e0248e284336b939235ff8e => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.779464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.888126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cdbd7-bc94-43ff-9cba-c95daddd8c5a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.916167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1742c-a31a-409c-b4d0-79f9a31effd5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.930067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.930741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.931099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.931324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.932192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:34.932558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.934317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.940456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 187/360] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:34.944519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.972273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.973354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.973789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.974240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.993727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:35.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:35.003236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:35.004064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:35.004679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 174/361] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:35.005817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.084779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d16dc-03c1-4e89-a748-62cb14896c05 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.127497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.128327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.128760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.129119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.130060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] RBAC: Adding query filter params (role.id=b8480fdf468c47c6ac29a741fafb616e, user.id=6f8c8f762821491b872dc4631f1bc25e, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:35.130481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.132245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0823-f387-4cf9-881c-c747db76e3e9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.143233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fbf6a-5fbe-4681-9c5f-55aaef0ad131 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.149947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 188/362] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/role_assignments?user.id=6f8c8f762821491b872dc4631f1bc25e&scope.system=all&role.id=b8480fdf468c47c6ac29a741fafb616e => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:35.152194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1a8e1-1a70-4e9a-8b89-ee49eb40ca73 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.152585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1a8e1-1a70-4e9a-8b89-ee49eb40ca73 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.152954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1a8e1-1a70-4e9a-8b89-ee49eb40ca73 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.158894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 189/363] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:35.160199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1a8e1-1a70-4e9a-8b89-ee49eb40ca73 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.192655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.193261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.193545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.193818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.194594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:35.194903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.196756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85387c09-28ad-4d55-9470-644dcb42d28f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.206565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 175/364] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:35.208086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.208450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.208829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.230692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:35.231917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:35.311166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 176/365] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:35.312267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.405758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1a8e1-1a70-4e9a-8b89-ee49eb40ca73 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.429200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803909b8-083b-4152-b3ef-a2f8bb0caae5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.454898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.455529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.455817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.456099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.456847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:35.457158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.458549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.468684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 190/366] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:35.469744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.470864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.471559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.471946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.472230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.547432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.548901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.584992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d222e-8a8d-4ef4-b154-e995003d9922 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.619408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.620279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.620568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.620847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.631836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:35.640441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:35.641426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:35.642231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 191/367] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:35.642907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.663342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 177/368] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:35.664261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.752236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae165554-0003-4c38-8e22-687fd1739e9f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.782344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8ff89-75b5-498e-b6df-e6aab80c8358 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.787004 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.787669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.787960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.788242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.817733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.818457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.818743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.819045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.819801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:35.820103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.821722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.834323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 178/369] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:35.835238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.865000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.866479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.966246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6dd3-bb78-421a-914f-7272d16314b6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.979964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 192/370] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:35.981462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.005430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.006213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.006493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.006765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.008030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.009555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.011953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 179/371] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.013125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.100754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdaacc-19ec-4f11-a900-19cc6563e594 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.127486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff3dab-c6f7-43d5-a097-fbce09943c07 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.141761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.142434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.142773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.143316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.168641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.169507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.169791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.170066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.171342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.172798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.174580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 180/372] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.175468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.234905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.236449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.302400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eac7d-09f9-4955-8cf4-2fcc18a4ab90 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.353319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.355301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.355780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.356239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.359688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.361142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 193/373] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:36.361347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.361862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.367087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 181/374] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.369092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.478642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78466a-5a9e-48ef-947f-84a973f0cf89 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.485426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f35e4-5a10-4a45-ad0e-3933e29121c0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.518366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.519812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.520278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.520751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.522747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.525956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.528194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.528905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 194/375] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.529651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.529840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.530056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.530392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] PATH_INFO: `/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.531823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] RBAC: Authorizing `identity:get_project(project_id=90e6c823fef84e7e88dc9cd3e45439fa)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.533358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.535429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 182/376] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:36.536584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.648066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef4789-e65d-4d6d-8ef6-c3167a8e04b0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.658041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5f78a-f185-4d78-af00-1cdf46b31b63 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.691442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.692493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.692959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.693429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.695463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=a8d946d9407d447aa42596aae92c9dd4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:36.696119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.698112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.699019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.699214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.699461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.699851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.700700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=a8d946d9407d447aa42596aae92c9dd4) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:36.701011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.703072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.705649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 195/377] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.706347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.711945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 183/378] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=db67dafa9e0248e284336b939235ff8e => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.827785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656584ca-c85b-4304-8a1e-3118a448ce10 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.866322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7f1f0-b3c6-4b04-af7b-59464e66721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.867234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7f1f0-b3c6-4b04-af7b-59464e66721e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.867521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7f1f0-b3c6-4b04-af7b-59464e66721e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.867803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7f1f0-b3c6-4b04-af7b-59464e66721e None admin] PATH_INFO: `/v3/groups/e193e856ee6147aea4cba0cd8f62289f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.874786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7f1f0-b3c6-4b04-af7b-59464e66721e None admin] RBAC: Authorizing `identity:get_group(group_id=e193e856ee6147aea4cba0cd8f62289f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.876335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7f1f0-b3c6-4b04-af7b-59464e66721e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.878482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 196/379] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/groups/e193e856ee6147aea4cba0cd8f62289f => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:36.884923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:37.038274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da925a-8b3e-4c36-83ce-45db0a05f5cf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:37.079649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:37.080329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.080612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.080889 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.081766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] RBAC: Adding query filter params (group.id=e193e856ee6147aea4cba0cd8f62289f, role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=90e6c823fef84e7e88dc9cd3e45439fa) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:37.082079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:37.083563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04283c30-7b5f-43b4-8011-0c06640501a8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:37.090210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 184/380] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/role_assignments?group.id=e193e856ee6147aea4cba0cd8f62289f&scope.project.id=90e6c823fef84e7e88dc9cd3e45439fa&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:37.658700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66e22-af2c-458f-aaca-c3106c31678a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.659510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66e22-af2c-458f-aaca-c3106c31678a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.660003 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66e22-af2c-458f-aaca-c3106c31678a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.661948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 197/381] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:37.668176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2cff8-c07d-4378-904f-a6cfd6815880 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.668754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2cff8-c07d-4378-904f-a6cfd6815880 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.669230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2cff8-c07d-4378-904f-a6cfd6815880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.689836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9aa2cff8-c07d-4378-904f-a6cfd6815880 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:37.691421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9aa2cff8-c07d-4378-904f-a6cfd6815880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:37.780112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 185/382] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:37.813872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66e22-af2c-458f-aaca-c3106c31678a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:37.821939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fd00c-0613-4c80-8eee-731e96069157 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.822564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fd00c-0613-4c80-8eee-731e96069157 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.823598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fd00c-0613-4c80-8eee-731e96069157 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.825539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 186/383] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:37.831690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.834067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.834285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.863522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:37.864699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:37.978574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66e22-af2c-458f-aaca-c3106c31678a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:37.994067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 187/384] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:38.017137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.017950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.018229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.018498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.025473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.033907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:38.045189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:38.046203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:38.047026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:38.047633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 198/385] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:38.052684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.173569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814918-be7e-4a9b-8c5a-da82645f543b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.235851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b04d-f19e-4ab6-9e16-b2936c85ee94 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.255724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.256538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.256822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.257097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.275563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.277153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.277450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.277731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.278487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:38.278795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.280201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.289731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 199/386] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:38.290036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:38.296629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:38.298174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:38.299085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:38.299892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:38.305505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 188/387] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:38.312113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.420938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1075-c26c-4bb3-9f27-be5af4afdcef None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.459835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.460754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.461209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.461629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.462523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:38.463006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.465456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.474636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 189/388] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:38.480837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.481144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed446f6-d9f4-41b7-a13c-0bb1dc5d9bcd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.545408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.546329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.546617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.546946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.548188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.549656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.555696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 200/389] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:38.561489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.583556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04510faa-e279-4d7b-9835-204112aa5ab9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.617946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.618806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.619133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.619402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.621205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.622651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.624637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 190/390] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:38.630104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.715923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7b49-3181-4575-938b-9820fec477fa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.732833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b98a3-809b-4822-9371-5c224bcc4bc6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.752409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.753287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.753570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.753844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.755128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.756655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.758780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 201/391] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:38.765393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.767983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.768857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.769137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.769416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.770910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.772398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.774397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 191/392] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:38.781052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.874491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f89ba-e63f-4106-a798-44605dccec1f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.884253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9821-fd32-4f80-9845-c72094a966e9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.909912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d91e18-d58c-4c41-8b96-83c7ce0bda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.910798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d91e18-d58c-4c41-8b96-83c7ce0bda89 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.912265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d91e18-d58c-4c41-8b96-83c7ce0bda89 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.912554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d91e18-d58c-4c41-8b96-83c7ce0bda89 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.914835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d91e18-d58c-4c41-8b96-83c7ce0bda89 None admin] RBAC: Authorizing `identity:create_grant(project_id=c022bdbf7b8c43b18889186e9f4dc4ff, group_id=1d8ce9b5b2204873a2209562e5b3b6b4, role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.916440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d91e18-d58c-4c41-8b96-83c7ce0bda89 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.920100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19904843-d1a8-4fa1-855e-76bc745ac172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.920987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19904843-d1a8-4fa1-855e-76bc745ac172 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.921460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19904843-d1a8-4fa1-855e-76bc745ac172 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.921741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19904843-d1a8-4fa1-855e-76bc745ac172 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.923748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19904843-d1a8-4fa1-855e-76bc745ac172 None admin] RBAC: Authorizing `identity:create_grant(project_id=c022bdbf7b8c43b18889186e9f4dc4ff, group_id=1d8ce9b5b2204873a2209562e5b3b6b4, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.925261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19904843-d1a8-4fa1-855e-76bc745ac172 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.010387 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 202/393] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 17:56:38 2022] PUT /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/db67dafa9e0248e284336b939235ff8e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:39.038576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 192/394] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 17:56:38 2022] PUT /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:39.842677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b351322-7142-45fb-9ae6-e953a513155b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.843333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b351322-7142-45fb-9ae6-e953a513155b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.843808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b351322-7142-45fb-9ae6-e953a513155b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.845574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 203/395] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:39.857267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.857785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.858269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.879350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:39.880792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:39.942543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a200-6cc5-4b11-a045-60101c2216eb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.942838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a200-6cc5-4b11-a045-60101c2216eb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.943153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a200-6cc5-4b11-a045-60101c2216eb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.944751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 204/396] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:39.951216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.951508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.951791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.972429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 193/397] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:39.977902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:39.979350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:39.994473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.124210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 205/398] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:40.147335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c267c1e-d974-481a-8152-730a0c7b074d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.159274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.209126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.209969 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.210256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.210535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.222472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:40.231607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:40.232651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:40.233428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 194/399] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:40.239212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.317171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572cce-29ef-4f5c-9178-164e03f75551 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.352618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ec8a-8b28-46ae-bc07-3c358605a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.353431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ec8a-8b28-46ae-bc07-3c358605a76d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.353715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ec8a-8b28-46ae-bc07-3c358605a76d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.354520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ec8a-8b28-46ae-bc07-3c358605a76d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.365672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ec8a-8b28-46ae-bc07-3c358605a76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:40.371307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845ad9-bbe9-44d4-a73c-4f3e228c073f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9cc2ec8a-8b28-46ae-bc07-3c358605a76d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:40.374482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:40.376563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 206/400] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:40.378479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4431-1433-45ff-a250-9fec59caa13e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.380234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4431-1433-45ff-a250-9fec59caa13e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.380234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4431-1433-45ff-a250-9fec59caa13e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.384566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 207/401] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:40.387126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4431-1433-45ff-a250-9fec59caa13e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.407172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.407843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.408124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.408396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.409149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:40.409452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.410813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6381c-fdbf-4fca-a5eb-6b17a7fd8392 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.420789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 195/402] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:40.422120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.422416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.422691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.440203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:40.441376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:40.502849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4431-1433-45ff-a250-9fec59caa13e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.511104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 196/403] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:40.512237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.539792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.540543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.540831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.541161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.542315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:40.542743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.544297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.554294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 208/404] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:40.560812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.615542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd3393-b99e-47f2-af04-e224d0ba6516 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.651299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.652765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.653050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.653326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.654618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.656107 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.657920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 197/405] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:40.658596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.671137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84edf5-e821-4d02-aac4-76b702310feb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.706239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.707062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.707353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.707635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.719116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:40.727071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:40.729523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 209/406] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:40.731615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.759766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e8cf0-07e9-4bfb-b575-09a9a6112913 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.793921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.794770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.795070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.795343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.796531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.797954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.799597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 198/407] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:40.800433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.838727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0600de-e021-4e9c-8d5f-a0ce7becc182 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.874816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.875721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.876008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.876290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.877623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.879135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.881204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 210/408] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:40.882096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.902760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e75b-16be-4cf2-9978-b55625b2326e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.938479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.939448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.939870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.940283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.941167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:40.941609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.943171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.952437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 199/409] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:40.953506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.992650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d4d93-ae44-4a07-a0d8-c78afdeaf4ba None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:41.029187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:41.030116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.030401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.030677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.032063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:41.033516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:41.035285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 211/410] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:41.036063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:41.058060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0706019-f442-4539-b821-c9431e2bfecb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:41.092713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:41.093838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.094260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.094699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.096857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d946d9407d447aa42596aae92c9dd4, group_id=1d8ce9b5b2204873a2209562e5b3b6b4, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:41.098444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:41.147841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4c7f9-4606-40bb-b4f9-30cd8f9909f7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:41.181491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:41.182815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.183175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.183520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] PATH_INFO: `/v3/groups/e193e856ee6147aea4cba0cd8f62289f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.184728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] RBAC: Authorizing `identity:get_group(group_id=e193e856ee6147aea4cba0cd8f62289f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:41.186168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:41.192698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 212/411] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:41 2022] GET /identity/v3/groups/e193e856ee6147aea4cba0cd8f62289f => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:41.192698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:41.255596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 200/412] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 17:56:40 2022] PUT /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:41.256642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:41.301837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb03e09-757d-49df-b2b7-eb8b78b48ca1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:41.346573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8608-cc5e-4de0-bb47-474c6e48bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:41.347754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8608-cc5e-4de0-bb47-474c6e48bb04 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.348270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8608-cc5e-4de0-bb47-474c6e48bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.348684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8608-cc5e-4de0-bb47-474c6e48bb04 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.351310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec8608-cc5e-4de0-bb47-474c6e48bb04 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d946d9407d447aa42596aae92c9dd4, group_id=1d8ce9b5b2204873a2209562e5b3b6b4, role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:41.353028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec8608-cc5e-4de0-bb47-474c6e48bb04 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:41.385803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b28d3-d6a9-4070-a97a-330564cb5940 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:41.427469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:41.428363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.428647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.428925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] PATH_INFO: `/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.430269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] RBAC: Authorizing `identity:get_project(project_id=90e6c823fef84e7e88dc9cd3e45439fa)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:41.432585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:41.435317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 201/413] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:41 2022] GET /identity/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:41.442596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:41.459584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 213/414] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 17:56:41 2022] PUT /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4/groups/1d8ce9b5b2204873a2209562e5b3b6b4/roles/db67dafa9e0248e284336b939235ff8e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:41.571384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74a79-a03f-429e-b5e0-a3ebbddf7f46 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:41.615397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f062f-7797-48db-a913-dc64fbbb67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:41.616308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f062f-7797-48db-a913-dc64fbbb67b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.616591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f062f-7797-48db-a913-dc64fbbb67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.616867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f062f-7797-48db-a913-dc64fbbb67b3 None admin] PATH_INFO: `/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa/groups/e193e856ee6147aea4cba0cd8f62289f/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.619145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f062f-7797-48db-a913-dc64fbbb67b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=90e6c823fef84e7e88dc9cd3e45439fa, group_id=e193e856ee6147aea4cba0cd8f62289f, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:41.621145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f062f-7797-48db-a913-dc64fbbb67b3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:41.725401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 202/415] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 17:56:41 2022] PUT /identity/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa/groups/e193e856ee6147aea4cba0cd8f62289f/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:41.832981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b2df-eae2-4fb2-8cc8-33aee56b70a4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.833315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b2df-eae2-4fb2-8cc8-33aee56b70a4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.833558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b2df-eae2-4fb2-8cc8-33aee56b70a4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.835012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 214/416] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:41.841725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.842026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.842303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.872139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:41.873387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:41.906478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84948c-25b8-42fe-a28a-7870d7f0a090 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.906812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84948c-25b8-42fe-a28a-7870d7f0a090 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.907067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84948c-25b8-42fe-a28a-7870d7f0a090 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.908756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 215/417] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:41.914319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:41.914942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:41.915445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:41.933778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:41.935359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:41.966537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 203/418] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:42.008196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.015119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 216/419] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:42.033713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.122002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf0c1a-7499-4f66-b176-61d15c4320ea None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:42.133372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5897-c824-4e52-9902-ed4f05d99d9a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:42.160183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:42.161019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:42.161271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:42.161552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:42.170559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:42.171989 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:42.172499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:42.172962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:42.173165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:42.181279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:42.183515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:42.184761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 204/420] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:42.191466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:42.192000 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:42.201323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:42.204496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:42.207043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 217/421] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:42.220071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.320724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f530b9b-b405-4639-ae93-94b2c44f2da5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:42.371423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:42.372109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:42.372394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:42.372671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:42.373438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:42.373745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:42.375346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:42.392153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 205/422] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:42.400022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.417739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784f54-700c-4f2c-ac11-d4ca7109aaaf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:42.461205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:42.461885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:42.462167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:42.462438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:42.463275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:42.463584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:42.464972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:42.485296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 218/423] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:42.491218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.590961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32dcfe-c4f0-4e65-a429-f9ec10e97a7f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:42.660252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:42.660910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:42.661194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:42.661468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:42.666836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132a4f-4a9a-4ed2-b02b-9fb006768989 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:42.735282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:42.735962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:42.736251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:42.736522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:42.799254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:42.800724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:42.871627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:42.874132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:42.962539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 206/424] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:42.968047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:42.991185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 219/425] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:56:43.000034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:43.078539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565cba7-1708-4cd1-b8b4-826f942c3c3a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:43.121532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:43.122455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:43.122664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:43.122933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:43.127693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:43.129135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:43.131165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 207/426] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:43.137051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:43.146036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021667-88f1-4bfc-912f-80d8b55d2e57 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:43.189438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:43.191458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:43.191458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:43.191458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] PATH_INFO: `/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:43.193034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] RBAC: Authorizing `identity:get_project(project_id=c022bdbf7b8c43b18889186e9f4dc4ff)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:43.194519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:43.196835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 220/427] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:42 2022] GET /identity/v3/projects/c022bdbf7b8c43b18889186e9f4dc4ff => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:43.203359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:43.290487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a666f35-d600-4150-83d1-451e547dab18 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:43.335782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:43.336645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:43.336932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:43.337210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:43.339884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:43.341328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:43.343012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 208/428] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:43 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:43.349763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:43.402818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def649a9-f48d-44ac-8dfb-c81f26245e29 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:43.451487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:43.452357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:43.452640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:43.452920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:43.457660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:43.459175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:43.460888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 221/429] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:43 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:43.467866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:43.558777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef4102-a074-46c3-ab31-e37ad81181e2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:43.610641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:43.611358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:43.611643 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:43.611922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:43.612762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:43.613136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:43.614512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020dea-8d60-45fc-a8e9-bb9bfd45d5e0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:43.629333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 209/430] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:43 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 611 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:43.632062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c8829-f662-4fab-94b9-dec0400d235e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:43.672620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:43.673211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:43.673496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:43.673772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:43.674615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:43.674927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:43.676417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd5b5-84f9-4c84-ad07-ce4344779d9e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:43.684181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 222/431] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:43 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=c022bdbf7b8c43b18889186e9f4dc4ff&role.id=db67dafa9e0248e284336b939235ff8e => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:44.021069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050f969-2dcb-48f8-99dd-81cba3934fda None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.021421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050f969-2dcb-48f8-99dd-81cba3934fda None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.021592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050f969-2dcb-48f8-99dd-81cba3934fda None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.023025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 210/432] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:44.029266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3aa5d-3690-4350-8d45-3fbcc5a4b4cf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.029568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3aa5d-3690-4350-8d45-3fbcc5a4b4cf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.029825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3aa5d-3690-4350-8d45-3fbcc5a4b4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.049191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-96b3aa5d-3690-4350-8d45-3fbcc5a4b4cf None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:44.050411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96b3aa5d-3690-4350-8d45-3fbcc5a4b4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:44.120381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 223/433] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:44.143713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050f969-2dcb-48f8-99dd-81cba3934fda None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.218567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3414-153f-4216-b679-f301f60b6e1b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.219089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3414-153f-4216-b679-f301f60b6e1b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.219197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3414-153f-4216-b679-f301f60b6e1b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.220510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 224/434] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:44.226092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.226405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.226649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.250026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:44.251280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:44.254482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050f969-2dcb-48f8-99dd-81cba3934fda None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.302655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.303498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.303787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.305094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.318834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:44.327582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:44.328512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:44.329312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 211/435] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:44.334398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.351637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 225/436] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:44.376610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.463958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162f91c-e5ba-45ca-94b6-d3cdecde9372 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.497601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d82592-5eae-4135-a51d-bbc2d89daadf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.500551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20956322-3e78-420a-8f81-698364a529fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.500925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20956322-3e78-420a-8f81-698364a529fa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.501208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20956322-3e78-420a-8f81-698364a529fa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.501484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20956322-3e78-420a-8f81-698364a529fa None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.502238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20956322-3e78-420a-8f81-698364a529fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:44.502547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20956322-3e78-420a-8f81-698364a529fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:44.504603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20956322-3e78-420a-8f81-698364a529fa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:44.514167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 212/437] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:44.515533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e530-c580-481b-bbe9-954c05dbba4c None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.515823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e530-c580-481b-bbe9-954c05dbba4c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.516118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e530-c580-481b-bbe9-954c05dbba4c None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.517595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 213/438] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:44.522417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e530-c580-481b-bbe9-954c05dbba4c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.537926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84decf4-4b56-4623-a38f-daf3d51298d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.538745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84decf4-4b56-4623-a38f-daf3d51298d0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.539095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84decf4-4b56-4623-a38f-daf3d51298d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.539377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84decf4-4b56-4623-a38f-daf3d51298d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.550226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84decf4-4b56-4623-a38f-daf3d51298d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e84decf4-4b56-4623-a38f-daf3d51298d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:44.558482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:44.559672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:44.560455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 226/439] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:44.561143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.561143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.561358 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.578234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:44.579436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:44.627964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e530-c580-481b-bbe9-954c05dbba4c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.643434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 227/440] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:44.644285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.672627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.673287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.673572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.673847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.739123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:44.739361 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d295c0-2706-47cb-ba6a-d2199bff0d49 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.740582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:44.771905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.772578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.772860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.773139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.773881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:44.774187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:44.776154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:44.783886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 228/441] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:44.784672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.836754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 214/442] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:44.837605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.886007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d544a-7a7c-49a1-969a-aa611d15a9e0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.918194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.919007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.919302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.919582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:44.929631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:44.936657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4bede-4428-4105-a448-5c1ae53cb3b6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:44.938239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:44.939128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:44.939951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 229/443] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:44.940609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:44.970286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:44.970927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:44.971235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:44.971505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.037943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.039440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.039739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b7bd-e6e1-4d37-a5fd-bfe118c04609 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.073140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.073994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.074278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.074554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.075779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.077289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.079021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 230/444] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.079792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.140719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 215/445] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:45.141482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.177517 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebb09-870c-421b-8c8b-6b87ac6cd383 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.213232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.213912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.214195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.214475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.215258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:45.215574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.216954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.225303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 231/446] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.226107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.240885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813be3-d38a-4976-9649-58c99eab387e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.274482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.275385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.275670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.275945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.277109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.278550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.280206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 216/447] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.280963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.324065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72642-c7fb-4e0e-8b97-51eb6eecfd33 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.356229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.357084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.357371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.357647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] PATH_INFO: `/v3/projects/a8d946d9407d447aa42596aae92c9dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.358821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] RBAC: Authorizing `identity:get_project(project_id=a8d946d9407d447aa42596aae92c9dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.360282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.362085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 232/448] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/projects/a8d946d9407d447aa42596aae92c9dd4 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.362833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.376723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224892-d565-4675-b636-43e32e12c07e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.409546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.410119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.410402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.410677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.458083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc268cb-6043-4034-818f-5d03890ac170 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.475853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.477302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.489880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.490528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.490808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.491106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.491931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=d5d4fe9c418e4d439e1de3e11ed84d07, scope.project.id=a8d946d9407d447aa42596aae92c9dd4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:45.492237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.493652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.499857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 233/449] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=d5d4fe9c418e4d439e1de3e11ed84d07 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.500628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.591208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 217/450] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:45.592435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.609715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f54ab-dd5e-42a9-b7ff-4c69fa410c41 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.645921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.646834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.647145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.647420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] PATH_INFO: `/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.648655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] RBAC: Authorizing `identity:get_group(group_id=1d8ce9b5b2204873a2209562e5b3b6b4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.650137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.652990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 234/451] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/groups/1d8ce9b5b2204873a2209562e5b3b6b4 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.659089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.704084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367a3f0-1605-45f7-97dd-697b434927d5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.750572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.751469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.751747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.752020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] PATH_INFO: `/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.753215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=90e6c823fef84e7e88dc9cd3e45439fa)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.754668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.756402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 218/452] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/projects/90e6c823fef84e7e88dc9cd3e45439fa => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:45.762788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:45.768184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965cd4d-2b08-4449-b7d9-0857a21c026d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.806184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f50289-6a26-4036-8211-061b416a423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.806411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f50289-6a26-4036-8211-061b416a423b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.806726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f50289-6a26-4036-8211-061b416a423b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.806897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f50289-6a26-4036-8211-061b416a423b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.807717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f50289-6a26-4036-8211-061b416a423b None admin] RBAC: Adding query filter params (group.id=1d8ce9b5b2204873a2209562e5b3b6b4, role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=a8d946d9407d447aa42596aae92c9dd4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:45.808033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f50289-6a26-4036-8211-061b416a423b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.809485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f50289-6a26-4036-8211-061b416a423b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.815546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 235/453] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/role_assignments?group.id=1d8ce9b5b2204873a2209562e5b3b6b4&scope.project.id=a8d946d9407d447aa42596aae92c9dd4&role.id=db67dafa9e0248e284336b939235ff8e => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:45.882143 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cf86d-b8e0-445e-8660-7c089d8a0fc6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:45.920183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45271449-ec75-4272-a1cf-3c8a281c3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:45.921051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45271449-ec75-4272-a1cf-3c8a281c3147 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:45.921330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45271449-ec75-4272-a1cf-3c8a281c3147 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:45.921603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45271449-ec75-4272-a1cf-3c8a281c3147 None admin] PATH_INFO: `/v3/groups/e193e856ee6147aea4cba0cd8f62289f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:45.922910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45271449-ec75-4272-a1cf-3c8a281c3147 None admin] RBAC: Authorizing `identity:get_group(group_id=e193e856ee6147aea4cba0cd8f62289f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:45.924415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45271449-ec75-4272-a1cf-3c8a281c3147 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:45.926162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 219/454] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/groups/e193e856ee6147aea4cba0cd8f62289f => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:45.932781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f50289-6a26-4036-8211-061b416a423b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:46.033157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f50289-6a26-4036-8211-061b416a423b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:46.067305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:46.067959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:46.068353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:46.068633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:46.069486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] RBAC: Adding query filter params (group.id=e193e856ee6147aea4cba0cd8f62289f, role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=90e6c823fef84e7e88dc9cd3e45439fa) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:46.069803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:46.071519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3f2b5-b1aa-4615-8957-f6996d64df5c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:46.077610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 236/455] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 17:56:45 2022] GET /identity/v3/role_assignments?group.id=e193e856ee6147aea4cba0cd8f62289f&scope.project.id=90e6c823fef84e7e88dc9cd3e45439fa&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:48.942873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15562c-b2f4-478c-a686-b0349ea97f53 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:48.943947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15562c-b2f4-478c-a686-b0349ea97f53 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:48.944435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15562c-b2f4-478c-a686-b0349ea97f53 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:48.946522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 220/456] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:48.953330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6acb1-3aa9-402d-8d37-d78008c96381 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:48.954200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6acb1-3aa9-402d-8d37-d78008c96381 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:48.954702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6acb1-3aa9-402d-8d37-d78008c96381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:48.980031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f4f6acb1-3aa9-402d-8d37-d78008c96381 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:48.981217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f4f6acb1-3aa9-402d-8d37-d78008c96381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:49.074328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 237/457] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:49.100752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15562c-b2f4-478c-a686-b0349ea97f53 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.184787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdac83-d52d-4f54-b1b1-79c9c09fbfb6 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.185448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdac83-d52d-4f54-b1b1-79c9c09fbfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.185926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdac83-d52d-4f54-b1b1-79c9c09fbfb6 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.187767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 238/458] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:49.193163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.193696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.194187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.240875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:49.242049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:49.245320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15562c-b2f4-478c-a686-b0349ea97f53 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.332670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:49.333474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.333760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.334037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.342638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 239/459] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:49.350515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:49.352185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:49.378924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9736123d-29fd-48f4-a2fe-acebf8c0ee37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:49.380780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:49.381657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 221/460] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513d8c-c7b8-459c-a00a-edd64834c4c3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513d8c-c7b8-459c-a00a-edd64834c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513d8c-c7b8-459c-a00a-edd64834c4c3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.386244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 222/461] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:49.390687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.390978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.391307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.409581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:49.410780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:49.485382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 223/462] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:49.492052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.520711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f118ed-3591-44ad-aa05-e25d2f6479d7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.566820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:49.568175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.568769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.569197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.584335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:49.586434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:49.611638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c48f54-0d77-49fb-8c11-b3ef9ecc2dfd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:49.612144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:49.612958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:49.613816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:49.613816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:49.613816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:49.613816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:49.613816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 240/463] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:49.614541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.655815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:49.656488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.656771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.657044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.657779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:49.658083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:49.659483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:49.677654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 224/464] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:49.678920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.726334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2706d-f12c-4033-a136-e735e2e0dc0b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.765886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:49.766604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.766889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.767197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.785487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:49.786978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:49.788916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e89f-5ce6-46ee-95c6-13d4abca6ec1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fc0a4022-afad-4e53-bd65-b24d22384693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:49.807855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:49.809766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:49.810820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:49.810820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:49.810820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:49.810820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:49.810820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 241/465] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:49.810820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0c8a5-d526-4ed2-9b6a-b887091e4a2a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.811176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0c8a5-d526-4ed2-9b6a-b887091e4a2a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.811466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0c8a5-d526-4ed2-9b6a-b887091e4a2a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.812717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 242/466] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:49.814346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0c8a5-d526-4ed2-9b6a-b887091e4a2a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.836277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:49.837232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.838271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.839026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.840012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:49.840478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:49.842423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:49.858406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 225/467] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:49.859443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:49.935508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0c8a5-d526-4ed2-9b6a-b887091e4a2a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.964346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141f965-3373-45a2-b228-3bef40ab9075 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:49.970247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:49.971496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:49.971951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:49.972374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:49.973225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:49.974919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:49.999321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.003343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.003343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.003343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.003343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:50.003343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.003343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4f9bf-c16f-443b-8ee9-7d423a05208f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.014182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 226/468] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:50.015454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.015747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.016077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.031991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:50.033181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:50.074163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 243/469] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:49 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:50.074970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.111018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 227/470] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:50.111018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.182672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fc1f5-c344-40eb-911a-339b6fd65721 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.220246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4a110-d397-408e-84eb-176bbbde4252 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.225712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27648b-9c15-4138-9156-0680806edd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.226410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27648b-9c15-4138-9156-0680806edd9b None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.226696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27648b-9c15-4138-9156-0680806edd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.226975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27648b-9c15-4138-9156-0680806edd9b None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.227748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27648b-9c15-4138-9156-0680806edd9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.230019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27648b-9c15-4138-9156-0680806edd9b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.257088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94815fca-2aca-4842-91eb-2d3e94b17aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.257763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94815fca-2aca-4842-91eb-2d3e94b17aec None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.258043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94815fca-2aca-4842-91eb-2d3e94b17aec None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.258342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94815fca-2aca-4842-91eb-2d3e94b17aec None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.259086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94815fca-2aca-4842-91eb-2d3e94b17aec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.261400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94815fca-2aca-4842-91eb-2d3e94b17aec None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.302796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 244/471] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:50 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:50.304147 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e07d-033a-4630-af19-927a2e457138 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.304438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e07d-033a-4630-af19-927a2e457138 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.304720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e07d-033a-4630-af19-927a2e457138 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.309164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 245/472] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:50.309164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e07d-033a-4630-af19-927a2e457138 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.366692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 228/473] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:50 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:50.369481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.369995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.370401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.406911 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:50.408283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:50.426894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e07d-033a-4630-af19-927a2e457138 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.468531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.469375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.469685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.469944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.483337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.484851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:50.504987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:50.505956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:50.506809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:50.506809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:50.506809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:50.506809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:50.506809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 246/474] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:50.514390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.550685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 229/475] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:50.583208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.640345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552687-e20b-4dbc-8b73-19896ec9b1ed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.676604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.677279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.677569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.677920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.678666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:50.678981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.680511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.694077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 247/476] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:50.700929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.713156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee853b-4e24-4bb6-9324-0ac12135373a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.750208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.751177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.751633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.752049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.752928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.754452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.788715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.sql.core [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 17:56:50.788715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 17:56:50.788715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [parameters: {'id': '37a643a8d2514fc58b0f50e31af36dba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 17:56:50.788715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80416) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() May 04 17:56:50.822483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return ref.to_dict() May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:56:50.823551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application yield resource May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.rollback() May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.force_reraise() May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise self.value May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application session.commit() May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 17:56:50.824714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._prepare_impl() May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.flush() May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._flush(objects) May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application compat.raise_( May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application flush_context.execute() May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rec.execute(self) May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 17:56:50.825802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:56:50.826745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:56:50.828252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [parameters: {'id': '37a643a8d2514fc58b0f50e31af36dba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:50.830033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 17:56:50.831812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:50.835283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c9455-7288-4876-9c43-ccd950a015ec None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.835741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 230/477] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 17:56:50 2022] POST /identity/v3/roles => generated 144 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:50.841673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.882801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.883519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.883803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.884113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.886023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.890645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.974432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 248/478] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:50 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:51.002558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41731429-e8cf-48e3-8952-84e6db12bae0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:51.046346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83d509-b6d0-4795-8b71-a1a401f40b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:51.047227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d509-b6d0-4795-8b71-a1a401f40b80 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:51.047516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d509-b6d0-4795-8b71-a1a401f40b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:51.047794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d509-b6d0-4795-8b71-a1a401f40b80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:51.066478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83d509-b6d0-4795-8b71-a1a401f40b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1f83d509-b6d0-4795-8b71-a1a401f40b80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:51.079323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:51.081496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:51.083625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 231/479] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:56:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:51.089659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:51.211708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acf8ee-d4ea-4572-94af-2e6128cc6bdf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:51.250183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:51.250875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:51.251237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:51.251521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:51.252287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:51.252601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:51.254027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3a9f2-3420-434e-9122-58b3298ab6ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:51.263934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 249/480] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:52.946218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d5e9e-85b6-42ba-9c8b-feca243b89d0 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.948131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d5e9e-85b6-42ba-9c8b-feca243b89d0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.948625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d5e9e-85b6-42ba-9c8b-feca243b89d0 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.950658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 232/481] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:52.956752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909bcb-701f-4e87-9656-3e37e62d3aa4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.957621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909bcb-701f-4e87-9656-3e37e62d3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.958110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909bcb-701f-4e87-9656-3e37e62d3aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.981150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a0909bcb-701f-4e87-9656-3e37e62d3aa4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:52.982693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a0909bcb-701f-4e87-9656-3e37e62d3aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:53.069425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 250/482] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:53.117927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d5e9e-85b6-42ba-9c8b-feca243b89d0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.224662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bbbc-b15b-4009-9eb1-6f7a5d07ca31 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.224955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bbbc-b15b-4009-9eb1-6f7a5d07ca31 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.225232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bbbc-b15b-4009-9eb1-6f7a5d07ca31 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.226587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 251/483] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:53.236450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692692dc-5ca0-4ddd-b1ca-d61fd140200d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.236721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692692dc-5ca0-4ddd-b1ca-d61fd140200d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.236999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692692dc-5ca0-4ddd-b1ca-d61fd140200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.249860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d5e9e-85b6-42ba-9c8b-feca243b89d0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.275410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-692692dc-5ca0-4ddd-b1ca-d61fd140200d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:53.276749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-692692dc-5ca0-4ddd-b1ca-d61fd140200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:53.314655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39903a08-5c47-4c90-af76-01693633402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.315500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39903a08-5c47-4c90-af76-01693633402b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.315787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39903a08-5c47-4c90-af76-01693633402b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.316065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39903a08-5c47-4c90-af76-01693633402b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.331771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39903a08-5c47-4c90-af76-01693633402b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-39903a08-5c47-4c90-af76-01693633402b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:53.341486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:53.342387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:53.343218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:53.343823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 233/484] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:53.345345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd4d6-a37f-412c-8a88-98e92e49fad0 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.345538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd4d6-a37f-412c-8a88-98e92e49fad0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.349192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd4d6-a37f-412c-8a88-98e92e49fad0 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.349192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 234/485] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:53.350867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd4d6-a37f-412c-8a88-98e92e49fad0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.371127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 252/486] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:53.372439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.372732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.373011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.411274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:53.412471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:53.468586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd4d6-a37f-412c-8a88-98e92e49fad0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.484324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 253/487] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:53.485269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.505698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.506462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.506818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.507318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.508146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:53.508524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:53.510757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:53.519903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 235/488] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:53.525391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.590706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7736-82b5-43d5-9b11-3144cdc4b24d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.625589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.626410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.626698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.626980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.632820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4753e-f79a-451b-9323-c1bd57b98b04 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.638691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:53.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:53.648764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 254/489] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:53.650866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.673821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.675075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.675561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.676067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.687161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:53.695555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:53.697023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:53.697828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:53.700567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 236/490] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:56:53.701642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.757461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47bf2d-74b0-463d-a1da-85ab85631aac None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.792438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.793237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.793527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.793804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.805054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:53.806891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:53.807539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d1f8-2cd8-4d3b-b2f7-50f21d24c154 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:53.827067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:53.828026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:53.828868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:53.828868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:53.828868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:53.828868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:53.833123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 255/491] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:53.834118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.850655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.851747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.852274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.853274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.854472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:53.855030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:53.856605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:53.865832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 237/492] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:53.867044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:53.944069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d07d3-46f6-4e05-abf7-4295c24cdaff None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.980111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8887846-42aa-487d-ad9e-c4b9fc44dab4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:53.982362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:53.982929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:53.983264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:53.983548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:53.984982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:53.984982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:53.985991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:53.995708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 256/493] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:53.996573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.020436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.021400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.021400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.021578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.022359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:54.022628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.024006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.036522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 238/494] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:54.041629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.099112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705873f-60a9-4498-8e6d-8b667021315a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.133185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.134630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.135021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.135286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.141020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1807099-4c83-423f-8ee0-ebf1ff0d2dd0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.146085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.147650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-87466fd3-b4fe-44cc-a9a5-59e17e439066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:54.164733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:54.165931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:54.166939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:54.166939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:54.166939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:54.166939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:54.166939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 257/495] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:54.167778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104f1d8-fa27-480f-87a7-ae839fe1ef1d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.168062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104f1d8-fa27-480f-87a7-ae839fe1ef1d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.168339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104f1d8-fa27-480f-87a7-ae839fe1ef1d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.169583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 258/496] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:54.170268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104f1d8-fa27-480f-87a7-ae839fe1ef1d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.180382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da053287-660d-467c-b61f-cbc754436cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.181709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da053287-660d-467c-b61f-cbc754436cae None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.181986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da053287-660d-467c-b61f-cbc754436cae None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.182255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da053287-660d-467c-b61f-cbc754436cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.192369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da053287-660d-467c-b61f-cbc754436cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.193792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da053287-660d-467c-b61f-cbc754436cae None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-da053287-660d-467c-b61f-cbc754436cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:54.213477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:54.214515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:54.215408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:54.215408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:54.215408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:54.215408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:54.215408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 239/497] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:54.215950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08cc8-7d2a-48b4-8811-b56358c45183 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.216199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08cc8-7d2a-48b4-8811-b56358c45183 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.216465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08cc8-7d2a-48b4-8811-b56358c45183 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.217981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 240/498] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:54.218388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08cc8-7d2a-48b4-8811-b56358c45183 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.276052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104f1d8-fa27-480f-87a7-ae839fe1ef1d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.309226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.309776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.310063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.310339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.315112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08cc8-7d2a-48b4-8811-b56358c45183 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.317655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.319135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5ea7139c-3f61-4424-94a0-16d75214886f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:56:54.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:54.335627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:54.336513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 259/499] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:54.339354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91aa1-cb2c-4d0c-a196-0de045a96707 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.339655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91aa1-cb2c-4d0c-a196-0de045a96707 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.339939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91aa1-cb2c-4d0c-a196-0de045a96707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.347530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.348184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.348463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.348736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.349452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:54.349752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.351140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.356497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8a91aa1-cb2c-4d0c-a196-0de045a96707 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:54.357689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8a91aa1-cb2c-4d0c-a196-0de045a96707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:54.362706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 241/500] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:54.363542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.421795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 260/501] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:54.423108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.423396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.423667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.439126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:54.440310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:54.479238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114c1d-5bb8-46e7-bcb2-e77ad1280377 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.504657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 261/502] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:56:54.505297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.512845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.513506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.513791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.514069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.514790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:54.515134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.516491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.529182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 242/503] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:54.530021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.599854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542309-bbe3-452e-b4cf-4786f51a1326 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.627623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948e5a-c892-4432-9839-11c00f4873d4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.632118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.632784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.633064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.633336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.634778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:54.635194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.636639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.662364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.663178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.663465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.663743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.671299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.672740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.673721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 262/504] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:54.674564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:56:54.690532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:54.691562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:54.692495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 243/505] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:54.693058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.773986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e8fb4-3236-4ca7-adfe-9714fb918ac6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.789488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321025cb-a313-465f-9699-803a9f4ba092 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.807403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.808191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.808471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.808745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.818388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.820118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:54.823560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.824349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.824629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.824900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.834631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:54.837860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:54.838814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:54.839705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:54.839705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:54.839705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:54.839705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:54.839705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 263/506] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:54.839965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:54.842389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:54.843456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 244/507] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:54.845074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:54.940050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba965-7e12-4918-a6f0-c0eff605de80 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.942441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7755c-4534-4c69-86f6-2770ec18e06d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:54.972324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.972973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.973261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.973537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.976081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:54.976870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:54.977150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:54.977433 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:54.986360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:54.987859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:56:55.002186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:55.003121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:55.004018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 264/508] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:55.004743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.039167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.041406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.104257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3e4ca-2789-494f-aca3-acbcb2e1aa14 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.135724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 245/509] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:55.136472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.140728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.141396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.141676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.141955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.142788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:55.143120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.144548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.163829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 265/510] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:55.163829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.238469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1a54-da6b-4dd9-8cc8-25286e9ffcc2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.259449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61b3f4-ffdb-49b3-8fa9-421133981d75 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.271626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.272284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.272566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.272844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.273562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:55.273870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.275353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.286234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 246/511] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:55.287136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.293209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.293813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.294100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.294379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.295157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:55.295470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.296847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.304970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 266/512] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:55.306397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.382085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be83163-313e-434b-b4c8-9e906e094a47 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.400449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355a39-29f8-49c4-ac13-7e114bd297ed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.421386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.422060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.422343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.422622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.423501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:55.423815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.425238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.433876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.434669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.434956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.435262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.445762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.448061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.464461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 247/513] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:55.465075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:55.465885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:55.466729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:55.466729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:55.466729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:55.466729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:55.466934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.467512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 267/514] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:55.467512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.564036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fd5eb-017a-4288-89c6-347ddcc513e7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.565859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f4c9-121d-46b7-8694-165a20a00c0e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.596767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.597431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.597716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.597993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.598447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.598722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.599117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.599404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.599682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.600208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.665404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.667010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.714154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 268/515] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:56:55 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:55.715011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.776257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 248/516] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:55.776257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.830820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ab4a-7688-4510-b1e1-9faeaf3bdef3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.867219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.868815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.869275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.869694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.881631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.883207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.884219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c3c2c-b200-4d4a-a9c0-b65d324a4dfb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:55.902748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:55.903723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:55.904640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:55.904640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:55.904640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:55.904640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:55.906161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 269/517] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:55.907107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.926613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.927324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.927608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.927883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.000262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.001711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.009889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fab4-8c55-4285-9240-e597580a33f4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.043406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.044073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.044354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.044634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.045356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:56.045654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.047053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.059043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 270/518] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:56.059863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.108913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 249/519] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:56.109680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.165576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dbaae-e960-476d-9ea6-be571719e37f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.209031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.209848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.210108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.210386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.221439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.222614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31ddbe-1bea-4458-ad9a-4ab59858db6a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.222905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:56.240741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:56.241800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:56.242862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:56.242862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:56.242862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:56.242862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:56.246598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 271/520] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:56.247482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.261112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.261780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.262064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.262342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.263106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:56.263417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.264872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.280849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 250/521] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:56.280849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.350121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6019a-1f74-4369-abf8-a56152df8b8f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.382490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950ea0a-d282-488c-9ff5-cd6407b3e743 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.384215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.385206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.385493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.385771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.392627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.394148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:56:56.411903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:56.412910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:56.413742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 272/522] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:56.414206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.424794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.425589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.428657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.428657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.437738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.439216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:56.458019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:56.458978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:56.460189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:56.460189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:56.460189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:56.460189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:56.460189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 251/523] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:56.460189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.526939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231fbc-ecf1-4935-ab86-756c73c6f67b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.560718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.561384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.561694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.562011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.562742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:56.563104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.564289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a32fe0-6d45-4800-b701-c9154de30e5e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.564497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.585148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 273/524] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:56.585982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.598707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.599545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.599819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.600096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.608976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.610421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:56:56.625880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:56.626820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:56.628081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 252/525] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:56.628655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.692564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592337-542c-4844-a8ff-2c177431cd1d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.726530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.727216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.727528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.727801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.728580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:56.728882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.730332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.731147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da0f4e-0fed-44c0-adb0-4ff7feabbf93 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.760021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 274/526] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:56.760021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.771851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.772524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.772812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.773124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.773825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:56.774188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.776148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.789452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 253/527] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:56.790395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.858939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aab10-5ce4-483f-9ee8-ac21dc37e227 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.895976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.896229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51b8c-022c-4584-b4e4-c6e3cdb75e0e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:56.897316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.897830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.898304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.906950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.908738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:56:56.923525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:56.924648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:56.925683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:56.927491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 275/528] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:56.928419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:56.939706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:56.940409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:56.940695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:56.940995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:56.941812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:56.942120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:56.943652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:56.962310 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 254/529] 10.222.0.23 () {56 vars in 1139 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:56.963460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.036894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41ff43-e1f5-4d81-ac83-f3b2912ec989 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.060565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7310-389d-46a2-990a-c378af9672f6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.074367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.075076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.075360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.075638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.076472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=4c7559dd645048dd99a4b8a5d3537230) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:57.076784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.078260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.095313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 276/530] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/role_assignments?user.id=4c7559dd645048dd99a4b8a5d3537230&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:57.095313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.095596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.096388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.096648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.096916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.105081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.106567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:56:57.122902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:57.124283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 255/531] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:57.125120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.219010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e848-2644-46fc-a58e-4a7364764e60 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.244842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5203b-1850-4150-b8d0-8b4dbac0d4b5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.256566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.257273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.257558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.257840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.259309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:57.259737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.261217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.279407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 277/532] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:57.280393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.284066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.284798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.285087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.285369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.370570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.372236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.388347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de34a-3d9b-401b-ae25-6c755ebc7054 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.424289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.424955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.425235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.425510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.426290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:57.426592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.428074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.441114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 278/533] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:57.441968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.496138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 256/534] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:57.497332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.558334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dad52-6d53-4dfa-8448-f04b615c0857 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.593911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.594655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.595041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.595395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.596281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=a8eeb8fcc242428cb31dc31e25e7865f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:57.596669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.597735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c399a3a-7211-476c-9741-024e82531794 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.598242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.604590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 279/535] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/role_assignments?user.id=a8eeb8fcc242428cb31dc31e25e7865f&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:57.605563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.636940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.637937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.638399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.638891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.639966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=e7ee1066de2a40f988f50b9b48a0ac5b) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:57.640660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.642383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.649292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 257/536] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/role_assignments?user.id=e7ee1066de2a40f988f50b9b48a0ac5b&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:57.729864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad310e-b800-4172-946c-bb3e846e6504 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.771983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.772779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.773057 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.773324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.786910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.788416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:57.817397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:57.818312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:57.819902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:57.819902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:57.819902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:57.819902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:57.819902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 280/537] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:57.824990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.957254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad6a9-d784-402b-86d8-660949264e0f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.993359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.994420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.994896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.995406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.996318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:57.996811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.998501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5a71-30e2-408b-8856-58bbc3953291 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.012788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 258/538] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:58.019142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.085991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dee8e-13b5-4636-8b1b-3257b412910f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.086687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dee8e-13b5-4636-8b1b-3257b412910f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.087182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dee8e-13b5-4636-8b1b-3257b412910f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.090119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 259/539] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:58.094691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.095303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.095774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.113585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:58.115166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:58.169807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf7669-267a-43cc-81a2-a66eeffaef5f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.191088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 260/540] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:56:58.210924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.251880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.253078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.254094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.254717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.269637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:58.273284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:56:58.294914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:58.296011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:56:58.296845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:58.308051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 281/541] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:58.314252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.353851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e5b2-fc7b-4b54-ac2f-4fd4887073cb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.395560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.400378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.400378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.400378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.417970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:56:58.427150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:58.435625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:58.436443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 261/542] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:58.439855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.510288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd98f-b94f-4b8b-81bd-774e4177920c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.565135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde28f0-de90-4b6a-87f3-2a0f72808394 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.580235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.580949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.581245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.581520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.582304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:58.582606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:58.584086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.603276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.604358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.604866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.605362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.606326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:58.606834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:58.608446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.613516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 282/543] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:58.621085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.623435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 262/544] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:58.630334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.786844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea33c1-21e9-4319-96f4-f06eff684f06 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.828390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba7530-36a1-4ac0-9ad4-05a993385173 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.842457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.843640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.844203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.844688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.865069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:58.867585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:56:58.895773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:58.896738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:58.897723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:56:58.897723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:56:58.897723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:56:58.897723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:56:58.906373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.907418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.907918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.908402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.909462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=635272c212ea47379b70362109b4804d) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:58.909990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:58.911683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.913053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 263/545] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:58.918893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.928616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 283/546] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/role_assignments?user.id=635272c212ea47379b70362109b4804d&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:59.042720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5230b-9071-4936-b745-8f5358f9b732 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:59.085073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:59.086190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:59.086736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:59.087532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:59.088709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:59.089251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:59.090928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:59.107545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 264/547] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:56:59.116342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:59.244176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a61c-6588-417a-8a03-98651db128f7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:59.291796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:59.292913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:59.293346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:59.293781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:59.301798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:59.303461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:56:59.321132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:56:59.322385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:56:59.323511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:56:59.325787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 284/548] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:56:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:56:59.331252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:59.489556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a23e9c-6b7f-4ebe-a942-cb4866c9034b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:59.530398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:59.531102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:59.531398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:59.531673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:59.532524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:59.532832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:59.534328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:59.557424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 265/549] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 17:56:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:59.562719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:59.706972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd54a5b-d7a8-4e84-8b87-42579970694a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:59.754308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b0e5-d649-4af1-9309-c8af8f51d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:59.754915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b0e5-d649-4af1-9309-c8af8f51d574 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:59.755226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b0e5-d649-4af1-9309-c8af8f51d574 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:59.755508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b0e5-d649-4af1-9309-c8af8f51d574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:59.850418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0b0e5-d649-4af1-9309-c8af8f51d574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:59.851908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0b0e5-d649-4af1-9309-c8af8f51d574 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:59.984764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 285/550] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:56:59.990349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.046861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891fcf-87a6-4374-ac6f-16c71fd25a0c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.047170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891fcf-87a6-4374-ac6f-16c71fd25a0c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.047450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891fcf-87a6-4374-ac6f-16c71fd25a0c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.049061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 286/551] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:00.054384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.054936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.055497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.081615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:00.084770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:00.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32688f0-1690-432c-bcd9-c411caba4b16 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.211936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 287/552] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:57:00.244879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905184e0-7da1-4383-99ca-037649738309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.245690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905184e0-7da1-4383-99ca-037649738309 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.245971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905184e0-7da1-4383-99ca-037649738309 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.246245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905184e0-7da1-4383-99ca-037649738309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.258059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905184e0-7da1-4383-99ca-037649738309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:00.259692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905184e0-7da1-4383-99ca-037649738309 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:00.272900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-905184e0-7da1-4383-99ca-037649738309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:00.282514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:00.283666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:00.284930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:00.284930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:00.284930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:00.284930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:00.284930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 266/553] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:00.291146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905184e0-7da1-4383-99ca-037649738309 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.409983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94750f-92a5-4efc-bdd2-911f37fcd975 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.459129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328ef5-267a-4a86-8d8d-6d9ba7e41921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.460197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328ef5-267a-4a86-8d8d-6d9ba7e41921 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.460626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328ef5-267a-4a86-8d8d-6d9ba7e41921 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.461047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328ef5-267a-4a86-8d8d-6d9ba7e41921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.471999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905184e0-7da1-4383-99ca-037649738309 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.472572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97328ef5-267a-4a86-8d8d-6d9ba7e41921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-97328ef5-267a-4a86-8d8d-6d9ba7e41921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:00.481023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:00.482118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:00.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:00.485352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 288/554] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:00.486725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0145-9135-4318-be5c-42befcb1f9a6 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.487162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0145-9135-4318-be5c-42befcb1f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.487602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0145-9135-4318-be5c-42befcb1f9a6 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.493275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 289/555] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:00.494812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.495271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.495700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.513380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:00.514017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.514686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.514964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.515281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.515552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:00.516009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:00.516312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:00.517759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:00.534290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 267/556] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:00.535215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.591137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 290/557] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:00.592087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.641140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fb0b-0396-4d06-9d6e-f9689d016bea None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.674914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.675528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.675814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.676093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.676845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:00.677150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:00.678529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505d56-23e9-4193-88c8-7bd4a809450c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:00.691602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 268/558] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:00.691602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303687e-4a59-4eb9-b5eb-e7c01d92e402 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.691602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303687e-4a59-4eb9-b5eb-e7c01d92e402 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.691602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303687e-4a59-4eb9-b5eb-e7c01d92e402 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.691602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 269/559] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:00.691602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303687e-4a59-4eb9-b5eb-e7c01d92e402 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.705377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0efe0-e360-4d2a-960c-82fb335f8b98 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.738246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.739058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.739346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.739620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.747315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:00.748780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:00.763305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:00.764200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 291/560] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:00.770317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.803886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303687e-4a59-4eb9-b5eb-e7c01d92e402 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.848325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fc371-ed4d-444a-aaf9-a8783329d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.849127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fc371-ed4d-444a-aaf9-a8783329d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.849415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fc371-ed4d-444a-aaf9-a8783329d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.849700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fc371-ed4d-444a-aaf9-a8783329d3d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.862011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fc371-ed4d-444a-aaf9-a8783329d3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-757fc371-ed4d-444a-aaf9-a8783329d3d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:00.870086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:00.871044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:00.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 270/561] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:00.873538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.873538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.873538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.879142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1f6b7-aee2-487d-9a05-c5b1ea219a60 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:00.890137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:00.891462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:00.918962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:00.920115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:00.920422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:00.920709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:00.934320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:00.936111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:00.958276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:00.959237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:00.960109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:00.960109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:00.960109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:00.960109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:00.960109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 292/562] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:00.960818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:00.971189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 271/563] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:00.971189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.066078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518141ab-cbdf-4d65-b92a-56cf70b20706 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.066373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe55720-0c15-466c-b575-eaa0a7e80215 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.100425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.101088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.101369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.101639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.102026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.102457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.102762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.102928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.103218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.103502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.104210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.104389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.104548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.105887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.118355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 272/564] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.118355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.121554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 293/565] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.126546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.224172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611b419-4599-448b-b3e2-a00a7285ac55 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.227692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d00d2-2f65-478b-971c-a4ed76728b57 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.257581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.258821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.259134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.259410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.260319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.260626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.261990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.265128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.266092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.266542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.266976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.273763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 273/566] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.274926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.278420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:01.286265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:01.287241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:01.288084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 294/567] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:01.288837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.386179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6803-a771-4740-880a-4444eaea770c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.394365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82e1c9-a28b-46cc-90ac-ddc24f9773db None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.423125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.423927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.424213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.424490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.428330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.431070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.431070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.431070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.431070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=14ec426f2eb64bb4b480b5ad42a43410) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.431398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.432725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.435853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.437299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.447286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 295/568] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/role_assignments?user.id=14ec426f2eb64bb4b480b5ad42a43410&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.447286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:01.470524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:01.471483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:01.472970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:01.472970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:01.472970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:01.472970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:01.472970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 274/569] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:01.478647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.561982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e631-1d0e-4248-bcc9-8f8e436043e7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.599071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.599856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.600150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.600403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.609640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.610087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e53f-1ba5-412c-9a71-b30bb9eea9a5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.611137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:01.626399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:01.628013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 296/570] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:01.629999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.659341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.660019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.660305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.660590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.661348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.661674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.663076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef961b2-0911-4ae3-b2d7-6ca8bddc1ba4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.671876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 275/571] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.673243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eefce-ae18-4ba4-bf74-e6c62c18efc6 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.673453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eefce-ae18-4ba4-bf74-e6c62c18efc6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.673732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eefce-ae18-4ba4-bf74-e6c62c18efc6 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.675273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 276/572] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:01.675990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eefce-ae18-4ba4-bf74-e6c62c18efc6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.742690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3bac6-5749-4284-ab79-175645d6d4dc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.779120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.779788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.780069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.780345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.781062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.781364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.782788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720debd1-5819-4ec0-a206-dd51a9f33611 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.784277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eefce-ae18-4ba4-bf74-e6c62c18efc6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.794736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 297/573] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.795777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.796062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.796334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.811902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:01.813156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:01.823869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.824541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.824831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.825114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:01.825947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:01.826261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:01.827752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:01.850218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 277/574] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:01.850218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.891192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 298/575] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:01.891192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:01.960745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fa87e-e51d-47e9-94aa-1ae411a1e1ff None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.986276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58f24-5615-4232-a182-facd423e9cfd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:01.995068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:01.995791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:01.996071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:01.996358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.006472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.007966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.022846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.024470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.024922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.025358 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:02.027125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.028155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.029068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:02.029068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:02.029068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.029068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:02.029068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 278/576] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.029513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.035997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.037650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:02.053054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.054050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 299/577] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:57:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.060130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.128189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2ddca-94cb-4576-9005-3bad508e89da None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.154461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031b7a-04b1-419b-9d11-843729c35bd8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.165057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.165943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.166278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.166552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.176740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.178169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.188992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.189790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.190076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.190348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:02.197017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.197935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.198860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:02.198860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:02.198860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.198860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:02.203414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 279/578] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.203633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.205085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:02.214120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.215092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:02.215948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:02.219607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 300/579] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.220692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.304240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18646-7ba3-442b-b3c4-273c866f5a42 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.321054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bda5cf-8a1b-49c7-8af6-9ba9e97ef6a1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.339339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.340067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.340298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.340578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.341308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:02.341617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.343031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.360895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 280/580] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:02.360895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.361979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.362663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.362945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.363253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.364110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:02.364417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.365876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.383975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 301/581] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:02.385066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.472208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daaad6-2177-4b30-b12e-0ad3772d5134 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.489041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d892a-4811-4840-97c5-d9d83818bcf0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.509064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.509725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.510011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.510289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.511039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:02.511352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.512847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.530243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 281/582] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:02.530243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.532730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.533406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.533688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.533961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.534714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:02.535039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.536408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.550264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 302/583] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:02.550264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.642636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbc5d9-0e32-42a2-82a7-a78c30da675c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.648573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99004-20ff-42d2-ab0f-4f581167d752 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.678721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.679557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.680504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.680865 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.681925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.682726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.683026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.683306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.688259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.689699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.693968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.695929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:02.704639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.705615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:02.706574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 282/584] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.708021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:02.718909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.719953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.725695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:02.725695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:02.725695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.725695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:02.725695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 303/585] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.725695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.809187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b5ee-3e31-433e-b6b1-382e38d45223 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.827393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794e418-4477-4c92-be47-0c8a059ebd0a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:02.845264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.846061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.846343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.846615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.854847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.856319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.861907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:02.862703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:02.863014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:02.863275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:02.870943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.871991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:02.872890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:02.876431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 283/586] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.876431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.878083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:02.879593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:02.896735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:02.897644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:02.898611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:02.898611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:02.898611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:02.898611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:02.898611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 304/587] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:02.899439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:02.983306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123509fe-d360-411e-b45f-917d3a9d20c0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.002730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1f9f-529e-4ee1-9ec5-059085212d11 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.017698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.018371 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.018659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.018938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.019905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.020223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.021643 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.037778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.038684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.038804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 284/588] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.039322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.039621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.039899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.040764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.041177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.042564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.055326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 305/589] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.056215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.143850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27004-a7f0-4aef-a925-edf94f7f0c1e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.162733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6d6dc-7b49-47ac-8028-a1aa37cafdab None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.178218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.178807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.179118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.179396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.180723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.181030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.182545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.199980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.200871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 285/590] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.201250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.201727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.201923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.202484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.203419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.203744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.205125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.223354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 306/591] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.223354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.302825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0575fd-1d2d-4cf8-ba38-b750abc3a78f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.319940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d878ee-e8cc-43db-b9ee-a47109dcd5a0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.336823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.337628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.337911 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.338187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.348257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.349741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.354934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.356330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.356803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.357269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.364588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.366233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:03.369165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:03.370195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:03.371675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:03.371675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:03.371675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:03.371675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:03.371675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 286/592] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:03.371970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:03.384078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:03.385076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:03.385980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:03.387287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 307/593] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:03.388340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.475467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843e58-8b39-4fd1-8ef8-ea0e7e4cbdda None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.488659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe0ed6-5add-451a-a29e-7405d2ac98ac None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.512108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.513028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.513315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.513596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/4c7559dd645048dd99a4b8a5d3537230/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.525720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.526542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.526829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.527143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.531098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=4c7559dd645048dd99a4b8a5d3537230, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.532760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.535559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.537114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:03.553542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:03.561211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 308/594] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:03.562129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.609040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 287/595] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:03 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/4c7559dd645048dd99a4b8a5d3537230/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:03.610234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.677696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389abd7-f5c7-4013-97af-bf6536efbda2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.716904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.718011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.718513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.718871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.719737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.720053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.721462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.734930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 309/596] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.735864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.746486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ebfd-db54-4953-8848-f79ff78ea6a8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.783321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.784002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.784483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.784600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.785371 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.785677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.787182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b5f87-5871-42fc-aac9-745ed542127d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.801924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 288/597] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.802121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b500a07-8191-46a2-af74-89f08c6b6b80 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.804273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b500a07-8191-46a2-af74-89f08c6b6b80 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.804273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b500a07-8191-46a2-af74-89f08c6b6b80 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.805467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 289/598] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:03.806246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b500a07-8191-46a2-af74-89f08c6b6b80 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.848748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6caa3-6294-4119-85c2-5cca0269e2cc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.882067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.882742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.883215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.883499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.884332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:03.884639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.886079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8761d-3d11-48dc-adb8-1559fa08df1b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.908136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 310/599] 10.222.0.23 () {56 vars in 1139 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:03.908136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.908136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.908136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.917084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b500a07-8191-46a2-af74-89f08c6b6b80 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:03.921860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:03.923063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:03.952649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:03.953448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:03.953728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:03.954011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:03.961274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:03.962733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:03.978930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:03.979909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:03.980817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:03.983297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 290/600] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:03.984301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:03.990409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 311/601] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:03.991208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.084877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b4b2-74eb-499f-9878-d1be79674b92 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.096767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade0c1-c267-4782-ab95-13b2e0433126 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.118893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.119990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.120223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.120495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/a8eeb8fcc242428cb31dc31e25e7865f/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.131975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.132801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.133086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.133359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.135676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=a8eeb8fcc242428cb31dc31e25e7865f, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.137129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.143722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.145152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:04.162246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:04.167897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:04.169656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:04.169656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:04.169656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:04.169656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:04.169656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 312/602] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:04.169656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.249903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 291/603] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:03 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/a8eeb8fcc242428cb31dc31e25e7865f/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:04.260279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.264487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98687-35ec-4796-979a-eca6dc345bdb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.305405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.306137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.306356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.306640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.307482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:04.307795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.309292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.328288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 313/604] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:04.329394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.385024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7d079-b48b-4edb-8ecd-bc261ea3c3d3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.424295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.425504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.426003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.426487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.440870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d461c-69e5-4c91-8c46-6db34001d979 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.441387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:04.451703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:04.452711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 292/605] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:04.453609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.485248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.486372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.486809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.487127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.487856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:04.488169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.490544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.506555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 314/606] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:04.507386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.557584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eaae2-737f-448e-bc59-a7fc7527304b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.596860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.598729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.599040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.599327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/e7ee1066de2a40f988f50b9b48a0ac5b/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.618408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=e7ee1066de2a40f988f50b9b48a0ac5b, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.620497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.634022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214897-3d54-4046-a3b9-f00494ed72e2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.672834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.673571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.673849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.674127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.674870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:04.675259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.676750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.689964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 315/607] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:04.689964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.715293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 293/608] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:04 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/e7ee1066de2a40f988f50b9b48a0ac5b/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:04.716638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:04.893836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a2d20-f0f9-4cb8-89ac-da7efe0f845b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.942788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:04.943637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:04.943927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:04.944469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:04.957082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:04.958549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:04.971249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc251f-6ce1-4f4f-9b35-0e3c35a1b2f8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:04.980876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:04.981887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:04.982775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 316/609] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:04.987843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.016994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.018765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.019348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.020052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.033529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.035702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:05.061784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:05.062739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:05.063721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:05.063721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:05.063721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:05.063721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:05.066520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 294/610] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:05.073545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.103396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bebdd-1bca-4333-a8fa-e1a731a1f5aa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.139106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.139928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.140377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.140755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.141787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:05.142105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.143733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.156971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 317/611] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:05.162400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.207028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cf5f5-7dd3-4cc6-9088-70216f372315 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.243610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.244331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.244620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.244899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.245632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:05.245940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.247337 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.260330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 295/612] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:05.265897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.341214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0e5de-4baf-40c3-9fe4-8643dd33226d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.370070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071cb4a-07fd-48b0-a176-95058a0c1712 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.392427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.397600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.397600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.397600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/635272c212ea47379b70362109b4804d/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.405909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.406760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.407194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.407430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.409767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=635272c212ea47379b70362109b4804d, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.411281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.416115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.417765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:05.439316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:05.440326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:05.441751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 296/613] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:05.447019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.506290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 318/614] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:05 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/635272c212ea47379b70362109b4804d/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:05.560574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eac55-1929-41d2-b706-49f2d47483d6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.597477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.598156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.598446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.598729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.599622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:05.599938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.602105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.623634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 297/615] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 17:57:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:05.629330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.741399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007c398-82c8-4d19-ad19-5dd13b527002 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.779354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.779750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.783017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.783017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.794021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.795576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:05.816351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:05.818575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:05.821413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:05.821413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:05.821413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:05.821413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:05.821413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 319/616] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:05.831018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.930786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aadf1-3d40-4113-8e38-4734c38bf84b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:05.966514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:05.967225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.967514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.967797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.968528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:05.968892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:05.970326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8df5-a28f-4e51-b7d5-d68bb001b106 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:05.983295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 298/617] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:05.989464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:05.992816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4ca01-4479-4bb4-84a4-2a1db8854a93 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:05.993766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4ca01-4479-4bb4-84a4-2a1db8854a93 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:05.994058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4ca01-4479-4bb4-84a4-2a1db8854a93 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:05.995629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 299/618] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:06.000841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.001551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.001551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.018564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:06.019809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:06.091038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 300/619] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:57:06.113994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:06.122802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370fff-a007-4fe5-8365-273ddbd506b8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.167777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:06.169389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.169881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.170587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.180533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:06.182590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:06.200000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:06.200967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:06.201864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:06.205309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 320/620] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:06.212548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:06.254421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2235376-d3ba-4d32-80c8-cdc24108036b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.344271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:06.345087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.345373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.345648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.346081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56624b22-9580-48df-bab9-4d9064ba4cad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.376085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:06.385673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:06.386678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:06.387559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:06.392585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:06.393273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.398119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.398119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.398119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:06.398119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:06.398425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 301/621] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:06.398515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:06.398758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:06.419556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 321/622] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:06.419556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:06.514550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff311563-b6fc-4d3a-b66e-bc839f0fc766 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.520996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e281a0-fb04-4d80-9c8a-32c4a23f0614 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.557198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:06.558097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.558381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.558659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/14ec426f2eb64bb4b480b5ad42a43410/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.574419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=14ec426f2eb64bb4b480b5ad42a43410, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:06.575381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:06.575935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:06.576793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.577307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.577780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.578759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:06.579290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:06.580831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:06.590546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 302/623] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:06.596040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:06.661778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 322/624] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:06 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/14ec426f2eb64bb4b480b5ad42a43410/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:06.702082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b7a2-0ee8-4adf-8a37-0212ea7ec9df None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.744056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:06.744874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.745158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.745435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.756983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:06.758801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-c3bbaf55-e963-4ff9-a007-bf305871f73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:06.778325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:06.779295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:06.781093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:06.781093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:06.781093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:06.781093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:06.781093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 303/625] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:06.785611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:06.906769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d256f-2856-4aa0-8e28-9dcb2b1ea47b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.907171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d256f-2856-4aa0-8e28-9dcb2b1ea47b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.907366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d256f-2856-4aa0-8e28-9dcb2b1ea47b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.908972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 304/626] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:06.914398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:06.914746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:06.915180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:06.924820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f35599-ebb4-458c-b41b-9db81094ad1e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:06.933208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:06.934409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:07.003723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.004763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.005241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.005710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.006626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:07.007195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:07.007797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 305/627] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:57:07.009328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:07.032365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.033071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 323/628] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:07.048581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.172764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f030f-2959-4f3c-b728-9b504a53ab31 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:07.178644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02d8c-1a9e-4150-8482-2eacbef2ec11 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:07.210888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.212170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.212459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.212737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.221245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:07.222717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:07.237945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:07.238950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:07.240095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 324/629] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:07.246865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.265499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.266300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.266583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.266863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.304076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:07.312511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:07.314662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:07.316675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:07.323523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 306/630] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:07.329151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.361502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c3740-ab0d-4271-a70b-4972bce10f60 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:07.401409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.402686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.402686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.403031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.403825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:07.404142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:07.406273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:07.427603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 325/631] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:07.435998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.515223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87167e7-c872-4ad3-ba29-a7b21bad87d7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:07.569032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.569629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.569908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.570245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.571063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:07.571366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:07.573490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:07.596992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 307/632] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:07.599372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.629191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca212f-f97f-45e0-95a6-fbda8575de31 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:07.696307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd683-d5d3-4f62-a536-1f4c945a3045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.696992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd683-d5d3-4f62-a536-1f4c945a3045 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.697276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd683-d5d3-4f62-a536-1f4c945a3045 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.697552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd683-d5d3-4f62-a536-1f4c945a3045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.789060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bd683-d5d3-4f62-a536-1f4c945a3045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:07.790652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bd683-d5d3-4f62-a536-1f4c945a3045 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:07.813821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd66c7-6ce1-4bb6-9a72-17a17e098565 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:07.855934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:07.856671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.856954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.857234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.869237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:07.870706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7ca22d65-f87a-49ba-8775-d052d3f52177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:07.888730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:07.891140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 308/633] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbc33-e5cd-4339-bd0e-0c67c04ed310 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbc33-e5cd-4339-bd0e-0c67c04ed310 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.893267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbc33-e5cd-4339-bd0e-0c67c04ed310 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.897302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 309/634] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:07.898563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fbc33-e5cd-4339-bd0e-0c67c04ed310 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:07.898742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 326/635] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:07.900424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:07.900880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:07.901285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:07.924303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:07.926249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:08.019979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fbc33-e5cd-4339-bd0e-0c67c04ed310 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.020612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 327/636] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:57:08.021610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.088243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.088930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.089218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.089499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.090229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:08.090537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.091944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.105630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 310/637] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:08.106662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.148935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c256491-1a67-4f24-8c05-4fa3382dd4ee None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.185113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.185915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.186202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.186482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.215069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.215069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:08.217846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:08.219822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:08.221892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:08.221892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:08.221892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:08.221892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:08.222385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326aa61-6dd1-4157-aa32-3a9d40e07b7d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.227020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 328/638] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:08.227020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.255509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.256306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.256592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.256927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.269080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:08.278382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:08.280597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:08.282567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:08.287032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 311/639] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:08.287032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.332485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7d5b-3a2f-4125-a331-35187e9398ee None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.368403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.369183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.369470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.369747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.377303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.378764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:08.393572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:08.395859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:08.398699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 329/640] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:08.407091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.407367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f5ed-65e6-48a0-906d-498b8a05a869 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.440251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.440976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.441266 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.441546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.442278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:08.442591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.444250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.458249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 312/641] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:08.459227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.503221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370addd4-8ae1-4402-9ff6-0e5ad3379ae0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.538507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.539793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.540082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.540346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.541082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:08.541386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.542761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.550707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 330/642] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:08.551542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.572848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64169-de63-4c31-8502-3271cc5e14b7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.613754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.614530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.614762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.615072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.615976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:08.616290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.618708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2802aa-b934-4499-9ff5-e2caf3ceb487 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.637454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 313/643] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:08.638831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95410a6a-9c18-4ae1-b24b-aa91dfafe3ad None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.639154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95410a6a-9c18-4ae1-b24b-aa91dfafe3ad None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.639432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95410a6a-9c18-4ae1-b24b-aa91dfafe3ad None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.640851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 314/644] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:08.641445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95410a6a-9c18-4ae1-b24b-aa91dfafe3ad None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.660875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4b25-571a-4992-b9a0-f6cc30f3fce6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.696380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.697170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.697448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.697716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.704974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.706405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:08.720789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:08.721745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:08.722723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 331/645] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:08.723259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.752282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95410a6a-9c18-4ae1-b24b-aa91dfafe3ad None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.786589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.787409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.787697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.787974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.798649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.800224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8635bafb-4812-4575-88c2-61fd153cfc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:08.818385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:08.819640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:08.821121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:08.821121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:08.821121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:08.821121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:08.821357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 315/646] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:08.822614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.822908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.823211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.831615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa7a0-6069-4c89-80e8-c7c9d438865c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:08.840564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:08.841757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:08.866283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:08.867158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:08.867787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:08.868119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:08.909627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 316/647] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:08.910350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:08.946817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:08.948540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.023251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb37c3-a42e-4c68-b07e-90b1ae84b235 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.050591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 332/648] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:09.050591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.068083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.069008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.069295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.069572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.070473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:09.070788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.072321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.084358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 317/649] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:09.085249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.154824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dfe21-b3d9-47e0-8b80-975b4811b336 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.189163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.189504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.189783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.190060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.190772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:09.191111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.192465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.195711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49a89-6197-4d3c-876b-7ef56ea0edca None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.205286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 333/650] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:09.206263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.234741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.235581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.235865 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.236143 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.247214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:09.254841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:09.255910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:09.256762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:09.259340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 318/651] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:09.260549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.314250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741d5a-af37-469f-9a47-973ea4bec1c1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.348143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.348991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.349293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.349862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.360934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.362408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.370094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f20be-2af0-4a1c-8ef1-30d03c75c7f2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:09.381417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:09.382479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:09.383599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:09.383599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:09.383599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:09.383599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:09.383599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 334/652] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:09.383599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.408046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.408767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.409055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.409337 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.410416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=4c7559dd645048dd99a4b8a5d3537230) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:09.410540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.411940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.427061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 319/653] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/role_assignments?user.id=4c7559dd645048dd99a4b8a5d3537230&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:09.427061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.505206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0749-91ba-4a1f-af72-d6cc1d51f831 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.541065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1250-bb47-490d-a9e6-525af90a59da None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.542936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.543784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.544079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.544354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.552606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.554064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:09.570915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:09.572153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:09.573129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 335/654] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:09.573725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.582898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.583741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.584112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.584460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.585297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:09.585762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.587761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039297-608a-49bb-a0ee-217ca395bfe5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.601641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 320/655] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:09.601641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb0e12-8263-429e-875b-fd4202c75af8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.601641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb0e12-8263-429e-875b-fd4202c75af8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.601641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb0e12-8263-429e-875b-fd4202c75af8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.602594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 321/656] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:09.606940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb0e12-8263-429e-875b-fd4202c75af8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.685034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d5fb5-204c-4457-983b-4f62473a801e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.719914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.720586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.720873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.721152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.721421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb0e12-8263-429e-875b-fd4202c75af8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.721914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:09.722183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.723616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.736534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 336/657] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:09.742295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.757345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.758466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.758747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.759093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.759954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:09.760258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.761675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68bffc-0e22-43b1-90c5-ab7058537c9d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.778862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 322/658] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:09.780183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.780470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.780744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.796519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:09.797686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:09.856635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99fc9c-1394-490f-bee1-9e4a9fab9394 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:09.867362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 323/659] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:09.867362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.892956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:09.893932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:09.894217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:09.894488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:09.905198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:09.906643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:09.925871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:09.926823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:09.928177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:09.928177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:09.928177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:09.928177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:09.928177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 337/660] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:09.928177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:09.977660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7c196-c660-4d96-9587-d89514068acc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.010531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.011267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.011551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.011821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.018413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.019893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.030460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3fbd5-ab42-4bc5-beca-9dd8f922809a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:10.035312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:10.036187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:10.037090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 324/661] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:10.037577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.067430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.068111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.068364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.068889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.138228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.139979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1ef0-5370-44ab-afb0-d074ae620dcb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.140403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.174600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.175718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.175985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.176255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.186794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:10.194787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:10.195774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:10.196607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:10.201968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 325/662] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:10.201968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.247350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 338/663] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:10.248385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.308116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3956ab4-275f-417e-8369-863aac0763ad None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.341846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.342516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.342802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.343111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.343837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:10.344147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.345531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.347882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079bc1a-ed39-4252-b114-9bc564dde2ce None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.358686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 326/664] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:10.359749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.383618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.384288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.384627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.384851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.385637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:10.385949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.387481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.403884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 339/665] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:10.403884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.463191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463adef6-5c1b-40d8-8bb8-853ea74d33e1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.499565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.500685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.501155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.501614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.502574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:10.503085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.504641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.505521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4410e-ce38-44c6-bb47-a514d1d547f3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.514132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 327/666] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:10.515248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.548367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.549166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.549449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.549719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.561406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.562843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:10.580830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:10.581771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:10.582667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:10.582667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:10.582667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:10.582667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:10.587146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 340/667] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:10.588335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.621167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd8650-c245-45e3-b8b4-72eee8532394 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.657556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.658356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.658641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.658918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.667327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.668826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:10.683914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:10.684891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 328/668] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:10.685923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.698655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b836a6-a961-4981-bfd5-41fb2587202b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.733914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.734928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.735507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.735790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.736767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=a8eeb8fcc242428cb31dc31e25e7865f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:10.737095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.738799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.755349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 341/669] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/role_assignments?user.id=a8eeb8fcc242428cb31dc31e25e7865f&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:10.755349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.794766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a972c-70ec-4784-85f4-1ec5e077cecd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.833925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.834541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.834907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.835884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.848102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.849568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:10.868898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:10.870072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:10.871111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:10.871111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:10.871111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:10.871111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:10.878742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 329/670] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:10.878742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.904457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b6020-f800-4b06-abae-f16baa16c185 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:10.940709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:10.941571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:10.941840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:10.942182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:10.943078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:10.943375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:10.945591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:10.959436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 342/671] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:10.961013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:10.991402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9faf5a-50a0-462a-978b-130e11645909 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.034308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.035370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.035834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.036260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.037255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:11.037711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.040285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.059494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 330/672] 10.222.0.23 () {56 vars in 1139 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:11.060597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.069499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b8de-b342-4eb3-ac72-22542871f67a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.105032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.105621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.105903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.106176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.106887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:11.107253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.108618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.121447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 343/673] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:11.122386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.170894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511e80c-ad29-47fb-b364-275651c6322e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.219044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.220128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.220577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.221005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.229364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.230469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921d47f-e2ef-4597-8f93-869cb0053716 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.231237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:11.246318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:11.247472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:11.248513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:11.250586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 331/674] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:11.251638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.265904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.266626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.266912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.267282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.336535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.337991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.356036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313698-5912-4f19-ac07-d83821bd7d9a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.390813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.391946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.392380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.392806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.402302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.403973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:11.419341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:11.420583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:11.421711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:11.423994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 332/675] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:11.424914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.447206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 344/676] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:11.450155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.531934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6044a-c8e2-4e31-aadc-47f2f64a9ef4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.547384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130c7b6-9d51-4260-af5f-6df161d7f438 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.567605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.568795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.569240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.570256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.571288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:11.571836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.573466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.582731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.583492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.583776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.584048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.584886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:11.585313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.587348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.589441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 333/677] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:11.590541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.610048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 345/678] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:11.610972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.702284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b668ff3-10d7-447c-89d4-aa036a4ae3e6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.717042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6657-1fa9-4883-9b47-83ca76603854 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.740243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.741290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.741854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.742384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.752337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.752995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.753301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.753538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.754354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.754473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=e7ee1066de2a40f988f50b9b48a0ac5b) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:11.754708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.756217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.756355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.763426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 346/679] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/role_assignments?user.id=e7ee1066de2a40f988f50b9b48a0ac5b&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:11.764309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:11.775954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:11.777081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:11.778199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:11.778199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:11.778199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:11.778199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:11.780174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 334/680] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:11.786710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:11.875570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9a16-5380-419c-a1a3-ecbdd93f0503 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.895579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd059-5759-434c-9c40-dc374544d4d2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:11.914176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eeb841-0c79-47e0-b4d5-9739394fb723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.917339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb841-0c79-47e0-b4d5-9739394fb723 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.917972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb841-0c79-47e0-b4d5-9739394fb723 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.918419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb841-0c79-47e0-b4d5-9739394fb723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.934661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:11.935368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.935658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.935936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.936691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:11.937002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:11.938411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c9dfd-84cb-420c-b09b-69e341df052e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:11.955030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 335/681] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:11.957985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a566e7-3f93-4967-af10-1faa6b0307ef None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:11.957985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a566e7-3f93-4967-af10-1faa6b0307ef None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:11.957985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a566e7-3f93-4967-af10-1faa6b0307ef None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:11.957985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 336/682] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:11.959091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a566e7-3f93-4967-af10-1faa6b0307ef None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.016663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eeb841-0c79-47e0-b4d5-9739394fb723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.018635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eeb841-0c79-47e0-b4d5-9739394fb723 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.096480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a566e7-3f93-4967-af10-1faa6b0307ef None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.134892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.135660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.135943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.136217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.137496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 347/683] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:12.139310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.139604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.139881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.143336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.145007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.157462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:12.158638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:12.162271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:12.163168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:12.164137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 337/684] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:12.165117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.240104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 348/685] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:12.241839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.275299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba902cd-6568-4b9e-9159-8b08585fbc12 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.309574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.310367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.310646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.310919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.322185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.323685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:12.342161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:12.343147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:12.344054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:12.344054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:12.344054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:12.344054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:12.344054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 338/686] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:12.345634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.349532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48558d08-d09f-4104-a047-7af7cc882c31 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.385386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.386389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.386885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.387411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.388455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:12.388991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.390659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.403307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 349/687] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:12.404411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.442598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e84428-87b6-442f-a549-b949401b0319 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.478310 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.479147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.479410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.479681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.490110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.491806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:12.510896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:12.511862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:12.512864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:12.512864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:12.512864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:12.512864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:12.512864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 339/688] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:12.513977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.516365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adc84-8d19-4a91-bb8f-f1a44987f865 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.552040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.553173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.553715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.554395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.555388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:12.555905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.557604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.571465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 350/689] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:12.572635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.613224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbf79-3358-402e-9bae-c12d64eea24d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.649444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.650021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.650302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.650576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.651437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=635272c212ea47379b70362109b4804d) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:12.651750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.653164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.659516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 340/690] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/role_assignments?user.id=635272c212ea47379b70362109b4804d&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:12.660338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.681441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad404d2-79b1-4510-b116-7eda865538ce None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.720273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.721792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.722318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.722800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.723825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:12.724394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.726198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.740414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 351/691] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:12.745565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.767687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3adf41-3a4f-4dd5-a2b1-b6b416a0db4d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.810349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.811201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.811481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.811749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.819929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.821402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:12.837566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:12.838548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:12.839503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 341/692] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:12.848095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:12.928708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241cc85-855b-4740-b38f-f8b4afd18e1d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:12.984983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8b51-9467-4c84-be3f-014b013f1841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:12.986073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8b51-9467-4c84-be3f-014b013f1841 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:12.986572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8b51-9467-4c84-be3f-014b013f1841 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:12.987107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8b51-9467-4c84-be3f-014b013f1841 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:12.988039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8b51-9467-4c84-be3f-014b013f1841 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:12.989695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8b51-9467-4c84-be3f-014b013f1841 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:13.003528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae817e3-92bf-46eb-a49f-1dcc6c44cb79 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:13.042446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:13.043055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.043296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.043573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.044363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:13.044674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:13.046240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:13.059065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 342/693] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:13.066140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:13.080311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 352/694] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:57:12 2022] POST /identity/v3/users => generated 254 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:13.239115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e8390-f544-4c27-a005-6d705c0970fd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:13.298723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:13.299588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.299945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.300357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.301284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=14ec426f2eb64bb4b480b5ad42a43410) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:13.301669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:13.303343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23f98-aad4-4a53-8031-da49d90ee928 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:13.316427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 343/695] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:13 2022] GET /identity/v3/role_assignments?user.id=14ec426f2eb64bb4b480b5ad42a43410&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:13.331307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93600-e7f9-448a-8b26-d9e5fe0f532d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.331307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93600-e7f9-448a-8b26-d9e5fe0f532d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.331615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93600-e7f9-448a-8b26-d9e5fe0f532d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.333105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 353/696] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:13.339468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.339760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.340041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.365648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:13.367511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:13.459350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 344/697] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:13.479363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93600-e7f9-448a-8b26-d9e5fe0f532d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:13.594369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93600-e7f9-448a-8b26-d9e5fe0f532d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:13.628761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:13.629569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.629851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.630126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.642511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:13.650297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:13.651458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:13.652499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 354/698] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:13.657592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:13.759286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6da33c-99eb-4cac-8f00-a5718b489ffc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:13.795873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:13.796541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.796824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.797142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.797897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:13.798204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:13.799595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:13.808413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 345/699] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:13.813951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:13.921219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c154a-4308-4801-ac74-cc39f4829aa7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:13.956033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:13.956784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:13.957063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:13.957332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:13.968343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:13.969718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:13.987808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:13.988846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:13.989757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:13.989757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:13.989757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:13.989757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:13.989757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 355/700] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:13.995534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.110697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d68ee-3c2c-4988-b92f-278ee8d90608 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:14.154799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:14.155780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.156240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.156655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.157535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:14.157983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:14.159563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa23743-078d-42f8-9512-6a7eaa83a1e0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:14.173183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 346/701] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:14.178725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.313723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d66c1-cbd0-4380-8a5c-b6689f7ba7e4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:14.323301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd696af-4386-493c-8751-9b83ceec1441 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.323589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd696af-4386-493c-8751-9b83ceec1441 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.323866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd696af-4386-493c-8751-9b83ceec1441 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.325456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 347/702] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:14.330745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.331050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.331334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.366565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:14.367474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:14.368501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.368935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.369390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.371645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:14.387385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:14.392856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:14.416238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:14.424123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:14.425289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 356/703] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:57:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:14.431079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.511567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 348/704] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:57:14.544717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.606782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735df31-6396-48d3-9496-c6bea81ffbfc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:14.669146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:14.669745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.670026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.670301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.670709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74fd40-baed-4b93-b9d8-d00df8496f74 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:14.671166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:14.671476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:14.672911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:14.705879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 357/705] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:57:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:14.712555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.716591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:14.717357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.717621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.718396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.718524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:14.720394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:14.742090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:14.743175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:14.744057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 349/706] 10.222.0.23 () {56 vars in 1129 bytes} [Wed May 4 17:57:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:14.751973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.902459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e7aa7-1ed9-4f33-8552-e3c7d6707383 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:14.924493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbb02-666f-44ce-a229-a54efa3905c6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:14.967218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:14.967887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.968169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.968446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:14.969157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:14.969462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:14.970828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:14.979046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 350/707] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 17:57:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:14.984861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:14.987835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:14.988510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:14.988795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:14.989069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.117965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:15.119757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:15.159589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ddd8b-f04f-431e-af08-8ff72286c6d2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:15.222076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:15.222748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:15.223063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:15.223348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.224069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:15.224377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:15.226387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:15.239656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 351/708] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 17:57:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:15.324265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 358/709] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:15.329540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:15.480859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d704e-f9ff-456b-a62f-d1dd502a2f9c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:15.521109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:15.522073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:15.522504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:15.522788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.534058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:15.535630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-fa8e9dc2-018f-40a4-8757-4e8877cc94d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:15.561773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:15.562822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:15.563744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:15.563744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:15.563744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:15.563744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:15.567156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 352/710] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:15.569683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:15.622586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651c56-0cbd-4566-9b96-f511c75686f2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:15.622904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651c56-0cbd-4566-9b96-f511c75686f2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:15.623185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651c56-0cbd-4566-9b96-f511c75686f2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.624926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 353/711] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:15.630719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:15.631078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:15.631309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.654890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:15.656129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:15.738101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c45b-1d96-4c5f-a162-b90d7dee43d5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:15.751231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 354/712] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:15.776519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:15.827750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:15.828457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:15.828785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:15.829104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.829870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:15.830221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:15.831678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:15.855588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 359/713] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:15.862472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:15.888474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f58a6-f038-443e-a644-7a83c9d8ed2a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:15.927268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:15.929312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:15.930071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:15.930495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] PATH_INFO: `/v3/services/network` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:15.931319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:15.932833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:15.947264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:15.948488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:15.949508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:15.952488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 355/714] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:15 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:15.958863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.045759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48053852-b60e-4613-b0c3-5e9e5e47b988 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.082180 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:16.083265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.084588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.085663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.093971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:16.095785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:16.113434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:16.114394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:16.115330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:16.118410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 360/715] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:16.126009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.173182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757c34-fb09-457d-bea2-d9a7c53bbe12 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.242312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:16.243019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.243308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.243584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.243917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbd699-100a-41a5-90bb-2004eef4beb1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.244292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] RBAC: Adding query filter params (name=network) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:16.244603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:16.245970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8e2d-79a3-4c94-8932-dbe9cd88de85 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:16.250681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 356/716] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:16.255025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db6226-b815-400a-8969-62913cd416f5 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.255025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db6226-b815-400a-8969-62913cd416f5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.255025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db6226-b815-400a-8969-62913cd416f5 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.258701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 357/717] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:16.260128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.260416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.260695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.279132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:16.280364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:16.291605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:16.292690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.293207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.293714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.294769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:16.295367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:16.297118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:16.310450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 361/718] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:16.316233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.352688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 358/719] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:16.359922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.421896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58241-66b2-406b-8deb-90ce79d420ec None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.456842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:16.457915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.458431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.459238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.460700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] RBAC: Adding query filter params (type=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:16.461048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:16.461714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed9ebf-7f94-422b-9d95-4870772989d9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.462473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:16.468527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 362/720] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:16.469360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.513172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:16.514203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.514688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.515253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.516306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=a8eeb8fcc242428cb31dc31e25e7865f) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:16.516828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:16.518536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059054a2-eb39-425d-9950-f2739a721015 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:16.525841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 359/721] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:16 2022] GET /identity/v3/role_assignments?user.id=a8eeb8fcc242428cb31dc31e25e7865f&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:16.527726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469151e9-b0ac-4c3b-938d-c23519cee6f6 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.528266 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469151e9-b0ac-4c3b-938d-c23519cee6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.528755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469151e9-b0ac-4c3b-938d-c23519cee6f6 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.530797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 360/722] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:16.543098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.543098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.543098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.588922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:16.590774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:16.650461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc6be-feb2-4a3a-b345-9759ebd42bde None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.707544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:16.708644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:16.709118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:16.709579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:16.722831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:16.731570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:16.732561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:16.733429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:16.741978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 363/723] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:16.743399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 361/724] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:16.744171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.791261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:16.923383 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e8b8-f4e6-4cf3-b4bd-3b1bbb6af4e4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:16.961002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb0e95-16af-45a9-a57c-5901e4cc0493 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:17.003715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.004590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.004882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.005157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.005913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:17.006289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:17.008279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:17.021410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 364/725] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:17.029966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:17.096011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.097072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.103024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.103517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.159813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:17.178003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:17.179697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:17.180585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:17.189088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 362/726] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:17.200759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:17.331015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8c183-081a-4539-b76b-85c4335640d8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:17.457584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.458833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.459360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.459871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.495919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:17.497739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:17.534980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:17.536010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:17.536929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:17.536929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:17.536929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:17.536929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:17.545149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 365/727] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:17.545661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:17.555549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062c10-0fc4-43b9-9377-72c4d82d1bee None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:17.628690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.629427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.629724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.630004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.630769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:17.631108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:17.634746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:17.654934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 363/728] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:17.660471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:17.700900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97919b-e5ce-4921-ab97-4fe31b244441 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:17.749278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.749878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.750164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.750444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.751272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:17.751590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:17.752976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:17.776981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 366/729] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:17.796529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:17.824790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3723-2d44-437c-a2b9-c65bd25a2b72 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:17.876559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.877379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.877663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.877938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.900250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:17.901726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:17.932394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2446b9-f64c-4736-87d6-1f0cdf816cc4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:17.933149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:17.934019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:17.934896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:17.934896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:17.934896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:17.934896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:17.943645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 364/730] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:17.949451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:17.974207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:17.975055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:17.976179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:17.976355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:17.991432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:17.992906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:18.025927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:18.027002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:18.027953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 367/731] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:57:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:18.031285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:18.105895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9739-b7fe-4a34-9dff-a96b654e53f1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.155724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.156405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.156691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.156970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.157705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:18.158008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.159424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.177279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 365/732] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:18.196292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:18.205109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ed79-4d21-4a23-87b5-59b969aa70c9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.252834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.253533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.253821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.254107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.254965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:18.255304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.256992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.287125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 368/733] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 17:57:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:18.290068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:18.316041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1830-55c3-49a9-8820-4fd841c226bd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.352432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.353558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.354110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.354393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.364395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.366523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-2f693450-dc6a-43e7-9f42-3be4f18e428e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:18.386928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:18.395348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 366/734] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c92a-6f52-4bb0-b2e8-736aa2fda38a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.396339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c92a-6f52-4bb0-b2e8-736aa2fda38a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.397066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c92a-6f52-4bb0-b2e8-736aa2fda38a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.397066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 367/735] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:18.397066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c92a-6f52-4bb0-b2e8-736aa2fda38a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:18.408498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72be74-c84f-4205-830f-22f48da1e63f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.454849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.456182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.457071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.457862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.515845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c92a-6f52-4bb0-b2e8-736aa2fda38a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.557063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.558129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.558618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.559167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.560234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:18.560773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.562436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07aaed-535b-49ff-9394-ae6509ab454d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.588583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 368/736] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 17:57:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:18.590523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.591072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.591610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.610274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:18.611887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:18.675109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.676719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.698118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 369/737] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:18.699791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:18.785050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 369/738] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:18.785588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:18.823579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9688b31-cede-401d-b28d-4b55ece77fa1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.871297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb309-6150-4aab-9e44-0263591604cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.873176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb309-6150-4aab-9e44-0263591604cb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.873763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb309-6150-4aab-9e44-0263591604cb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.874257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb309-6150-4aab-9e44-0263591604cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.899135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660aed3-cb53-4c32-a4e5-f3d7d810f21e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:18.936076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:18.936747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:18.937032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:18.937310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:18.938039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.939560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:18.963663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb309-6150-4aab-9e44-0263591604cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:18.965475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb309-6150-4aab-9e44-0263591604cb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.050776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 370/739] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:18 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:19.051829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.072161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 370/740] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:57:19.074055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f612-487e-44f1-9dde-8f7c5452f46d None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.074188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f612-487e-44f1-9dde-8f7c5452f46d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.074385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f612-487e-44f1-9dde-8f7c5452f46d None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.075855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 371/741] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:19.076637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770f612-487e-44f1-9dde-8f7c5452f46d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.175200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b82ad-b358-4096-80b4-a0279419b0e3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.185733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770f612-487e-44f1-9dde-8f7c5452f46d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.219126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.219950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.220271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.220546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.229124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.229932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.230209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.230486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.232251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:19.234728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.241579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:19.243058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3b900402-4b98-4b45-9db8-a7e8067fa787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:19.251828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:19.252740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:19.253653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:19.253653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:19.253653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:19.253653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:19.253653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 371/742] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:19.253950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1940d-9b75-4692-acfb-aebdb7e7c99c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.254813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1940d-9b75-4692-acfb-aebdb7e7c99c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.254813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1940d-9b75-4692-acfb-aebdb7e7c99c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.257423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 372/743] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:19.261601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3fabb-396e-42e4-9a8c-2816c89a3368 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.261601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3fabb-396e-42e4-9a8c-2816c89a3368 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.261601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3fabb-396e-42e4-9a8c-2816c89a3368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:19.264276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:19.265163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:19.266098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:19.266098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:19.266098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:19.266098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:19.266098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 372/744] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:19.267886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.276509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ffb3fabb-396e-42e4-9a8c-2816c89a3368 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:19.278338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ffb3fabb-396e-42e4-9a8c-2816c89a3368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:19.347106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 373/745] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:19.350642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.351051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.351564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.371868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:19.373044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:19.381505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27cc8a-77c9-40ed-9584-5e1ddb4be114 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.416761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.417542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.417789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.418069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.418807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:19.419148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:19.420682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.437725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 373/746] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:19.437725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.459010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 374/747] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:57:19.459010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.553777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c4fd-38ee-4eb2-a347-db8596154af6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.555364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51df33-414c-4ca5-a1bc-9b0664959652 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.587215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.587980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.588195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.588423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.589136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:19.589445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:19.590878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.593968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.594636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.594939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.595247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.595963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:19.597403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.603176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 374/748] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:19.604014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.671022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 375/749] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:19 2022] POST /identity/v3/services => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:19.671022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.726809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c175cf8-00c9-458f-b1a2-9b6b617d42ed None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.793532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675ebb-3737-43b7-b448-0fdc3bddfb0f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.793808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.794619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.794907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.795222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.807272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:19.809364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:19.828992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:19.829970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:19.830858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 375/750] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:19.831453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.838341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:19.839289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:19.840372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:19.840372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:19.852461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:19.860460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:19.861689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:19.862746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:19.864818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 376/751] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:19.866486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:19.979255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfffc-af02-40ee-8a64-930f78b04304 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:19.991543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7481711-368f-4e76-a191-1552346a6d74 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.021884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.023683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.023965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.024243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.026911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.027597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.027878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.028152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.028940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:20.029246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.030706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.031204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.032811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.043792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 377/752] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:20.044705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:20.050312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:20.051243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 376/753] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:20.052556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.144277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae68b-01c1-483f-bbd1-c4a0dbfc2026 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.185056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bab52-2209-4ecb-8a70-1250a58cd255 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.192463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.194082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.194593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.195099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.196476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:20.197276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.199412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.211913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 378/754] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:20.214312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.221715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.222540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.222916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.223310 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.224247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=15b8dc2e53bb436ab21bf6559244c7c4) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:20.224652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.227026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.233052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 377/755] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/role_assignments?user.id=15b8dc2e53bb436ab21bf6559244c7c4&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:20.233978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.364577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923365f-4561-4bd1-959a-8f890f392d8a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.376637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10d874-1ba1-4342-a591-180e4002bce6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.437829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.438425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.438725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.438965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.439783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:20.440089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.441540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.449136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.450317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.450976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.451474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.463968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.465870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.466191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 379/756] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:20.471841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:20.485612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:20.486575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:20.487513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:20.487513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:20.487513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:20.487513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:20.489849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 378/757] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:20.495852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.585025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c808-149d-4063-8af2-18fa97b7a43f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.608706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1233-4b30-4350-b44d-c4ec9120ef89 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.620165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.620830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.621111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.621384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.622216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=14ec426f2eb64bb4b480b5ad42a43410) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:20.622523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.624252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.630475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 380/758] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/role_assignments?user.id=14ec426f2eb64bb4b480b5ad42a43410&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:20.649429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.650379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.650844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.651302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.652212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:20.652692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.654263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.670071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 379/759] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:20.675319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:20.793032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83334c6-54ec-4f7b-9b27-4b7a1cac3b94 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:20.828807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:20.829711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:20.829992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:20.830266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:20.839126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:20.840921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:20.857124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:20.858143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:20.859115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 381/760] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:20.864209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:21.142320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe1cd1-704d-4ab4-94b4-3401c0d0a4f4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:21.188158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:21.188839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:21.189129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:21.189405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:21.190253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:21.190564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:21.192015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:21.222631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 380/761] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:57:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:21.228038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:21.381277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f2ff4-b087-438a-bbb6-6db99877dd98 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:21.425728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:21.426769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:21.427225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:21.427727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:21.444115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:21.445970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:21.467577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:21.469095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:21.470168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:21.470168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:21.470168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:21.470168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:21.471790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 382/762] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:21.478023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:21.628601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30719-0bb9-4f13-a3d9-6981865c75af None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:21.672810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:21.673490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:21.673776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:21.674054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:21.674787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:21.675122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:21.676543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9a7d-6945-4a19-a1a0-13469e0f684e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:21.696298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 381/763] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:21.701251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:21.747466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9182f-0e23-462d-beb4-1b4d4f08690e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:21.747803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9182f-0e23-462d-beb4-1b4d4f08690e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:21.748028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9182f-0e23-462d-beb4-1b4d4f08690e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:21.749839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 382/764] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:21.762677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:21.763224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:21.763585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:21.797307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:21.798518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:21.872131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba27c4-7c55-4193-a2c1-590033ff4a9c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:21.907403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:21.908448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:21.908851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:21.909130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:21.916244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:21.917707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:21.933021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:21.933952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:21.934860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 383/765] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:21.939845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:21.976723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 383/766] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:22.013764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.043105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c189bf6-9c47-462b-a6aa-bc891f7d418f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.077278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.077940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.078221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.078520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.079306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:22.079612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.081038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.093975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 384/767] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:22.099587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.205995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3adfe-cc52-419a-9383-ed4a8d7928da None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.244635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e216-1c3b-4d03-b3ae-20f4ed20d8f6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.248148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca9fe5-4ff5-4a1f-bbe5-aec6f5478407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.249288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca9fe5-4ff5-4a1f-bbe5-aec6f5478407 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.249800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca9fe5-4ff5-4a1f-bbe5-aec6f5478407 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.250282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca9fe5-4ff5-4a1f-bbe5-aec6f5478407 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/a8eeb8fcc242428cb31dc31e25e7865f/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.258521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca9fe5-4ff5-4a1f-bbe5-aec6f5478407 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=a8eeb8fcc242428cb31dc31e25e7865f, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.260329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca9fe5-4ff5-4a1f-bbe5-aec6f5478407 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.290370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.291548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.292044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.293086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.293213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.294717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:22.307615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:22.308597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:22.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 384/768] 10.222.0.23 () {56 vars in 1129 bytes} [Wed May 4 17:57:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:22.317457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.348838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 385/769] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:22 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/a8eeb8fcc242428cb31dc31e25e7865f/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:22.409754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26a0ad-4343-4aaa-8ca8-e38401cca41d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.410087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26a0ad-4343-4aaa-8ca8-e38401cca41d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.410314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26a0ad-4343-4aaa-8ca8-e38401cca41d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.412006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 386/770] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:22.418688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.419313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.419808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.452553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59145d88-1c9b-4c70-a0ed-7c4c94937773 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.469322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:22.470635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:22.527161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.528518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.529008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.529481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.530389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:22.530883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.532598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.539863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 385/771] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 17:57:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:22.545949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.606341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 387/772] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:22.630158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.684017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e84bd-7c32-4b94-b28c-a9a8ebfe18ff None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.722157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.723336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.723852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.724332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.725303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:22.725855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.727489 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.733225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 386/773] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 17:57:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:22.743134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.745059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3349a-fe0f-4957-97ab-c6cf02466c8d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.796288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.797101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.797383 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.797659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] PATH_INFO: `/v3/services/network` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.798316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.799719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:22.835803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:22.836849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:22.837707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:22.838452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 388/774] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:22 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:22.846165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:22.907762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2af07e-3d03-47f5-a8f3-b0face5a5d6b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.974559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:22.975284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:22.975567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:22.975844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:22.976981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] RBAC: Adding query filter params (interface=public, service_id=85e142b8dfc148bca658a35ee685f271, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:22.977303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:22.978673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:22.979056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926999b-59bb-4221-b895-e56ba14cd3bc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:22.996608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 387/775] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:22 2022] GET /identity/v3/endpoints?service_id=85e142b8dfc148bca658a35ee685f271&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:23.007158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.020608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.022287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.022792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.023327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.024265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] RBAC: Adding query filter params (name=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:23.024785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:23.026373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:23.036095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 389/776] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:23.038258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.141132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056158f-6ecd-4ea8-b0d9-323808608f8d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.176668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.177968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.178480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.179121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.180075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] RBAC: Adding query filter params (type=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:23.180597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:23.181816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f039a-57fc-44d3-b124-8ff057020480 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.182463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:23.192885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 390/777] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:23.194755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.216894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb896-1f33-4899-b7fc-c5cd65274067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.217424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb896-1f33-4899-b7fc-c5cd65274067 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.217704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb896-1f33-4899-b7fc-c5cd65274067 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.217981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb896-1f33-4899-b7fc-c5cd65274067 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.218667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb896-1f33-4899-b7fc-c5cd65274067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:23.220233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb896-1f33-4899-b7fc-c5cd65274067 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:23.225772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 388/778] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:23.249330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793ac1e-4b37-4437-96de-bd5c4a844ba4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.249684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793ac1e-4b37-4437-96de-bd5c4a844ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.249879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793ac1e-4b37-4437-96de-bd5c4a844ba4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.251505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 389/779] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:23.259644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.259863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.260145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.296728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:23.297912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:23.322854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240fc87-4372-4000-b686-a43c7c94ddca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.358496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.359618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.360157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.360666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.361725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] RBAC: Adding query filter params (interface=public, service_id=ff9b77866c334be0b07a77933846ca51, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:23.362308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:23.363955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:23.377817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 391/780] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/endpoints?service_id=ff9b77866c334be0b07a77933846ca51&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:23.379826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.382754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 390/781] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:23.426851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.496533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8f55-a206-407d-b29f-5362a4f12681 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.532610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d2b4-e03e-4fbe-8389-3686b023e220 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.534244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.535122 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.535577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.535994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.536830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:23.538625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:23.551109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 392/782] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:23.572505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f2949-1089-40a6-aca6-0c7ee808a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.573481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f2949-1089-40a6-aca6-0c7ee808a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.573868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f2949-1089-40a6-aca6-0c7ee808a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.574304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f2949-1089-40a6-aca6-0c7ee808a8a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.586672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f2949-1089-40a6-aca6-0c7ee808a8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e17f2949-1089-40a6-aca6-0c7ee808a8a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:23.594574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:23.595615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:23.596678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 391/783] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:23.604406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.680657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25942a88-ca35-43ba-8cb3-5629007dc731 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.680964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25942a88-ca35-43ba-8cb3-5629007dc731 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.681215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25942a88-ca35-43ba-8cb3-5629007dc731 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.682874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 392/784] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:23.688628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.688917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.689198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.711677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:23.712897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:23.778966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185504-0420-4256-b3d2-496a59ed18d5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.820029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:23.821177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:23.821764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:23.822249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:23.823264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:23.823779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:23.824661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 393/785] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:23.825800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:23.839107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 393/786] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:23.847561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.847742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:23.973313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0863d9-f574-4771-940d-936b591c95a7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:23.986918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3196f-0fec-4f2d-9844-f2e1a794f0d8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.009256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.010058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.010341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.010618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.021421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:24.029949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:24.030903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:24.032539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 394/787] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:24.033268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.036040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.036040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.036040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.037315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.052243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.054354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:24.078953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:24.081121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:24.083505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:24.083505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:24.083505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:24.083505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:24.088638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 394/788] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:24.094357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.140886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad528200-96e5-4150-8378-c64d691f4966 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.174622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.175327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.175614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.175934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.176625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:24.176933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.178880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.187648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 395/789] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:24.193389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.294024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829f77e-7f21-4d34-ae17-ec7ce2b6519e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.329038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.329840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.330126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.330402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.341891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.343454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:24.361214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:24.362149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:24.363529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:24.363529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:24.363529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:24.363529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:24.363969 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e359e-644b-4c92-a117-2274ed70faf3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.364048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 396/790] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:24.369187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.448734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.449402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.449684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.449991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.450680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:24.451003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.452365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.472175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efa2b-a290-44ca-9cd6-45f6eb0fffed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.478656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 395/791] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:24.483934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.512707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.514107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.514781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.516364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.517368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:24.518596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.520743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.548193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 397/792] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:24.551557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.656533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff21d-7cd5-479f-9840-59d9fd14cfca None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.719922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.721150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.721660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.723102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.728435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985d895-7ae2-4a8f-a941-c5ad6e92d827 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.737403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.745309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:24.766808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:24.767872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:24.768842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:24.773271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 396/793] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:24.778544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.802419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.804372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.804895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.805400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.822554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.824394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:24.847977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:24.849013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:24.850145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:24.856575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 398/794] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:24.862408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:24.932793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bb6c6-0728-4457-a937-0da2313ca60a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:24.977392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:24.978548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:24.979090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:24.980038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:24.981109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:24.981968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:24.984423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac9040-831d-4f53-be63-5facbd31e900 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.008675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e388-9aeb-4c80-a6e1-45755a2a2206 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.012038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 397/795] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:25.013869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b47d3-8a43-4dd8-b6fe-e20d6886d3bf None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.014384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b47d3-8a43-4dd8-b6fe-e20d6886d3bf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.015230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b47d3-8a43-4dd8-b6fe-e20d6886d3bf None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.017761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 398/796] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:25.018854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b47d3-8a43-4dd8-b6fe-e20d6886d3bf None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.056440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.057044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.057324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.057597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.058424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:25.058731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.060394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcdda5-5a5e-4b5b-862f-532148e26cbf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.084911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 399/797] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 17:57:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:25.086391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.086682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.086963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.106734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:25.108300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:25.133898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b47d3-8a43-4dd8-b6fe-e20d6886d3bf None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.170251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.171541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.172061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.172645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.184405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.186391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.187021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 400/798] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:25.187870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:25.233556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:25.234528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:25.236608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:25.236608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:25.236608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:25.236608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:25.236608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 399/799] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:25.236608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.319534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430710-e1ac-40f5-8761-76a6d1fde6ef None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.345339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04301-ad26-40d4-98a9-299681d0ec10 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.353558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.354359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.354640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.354916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.366435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.367931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.385122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:25.386161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:25.387083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:25.391479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:25.391479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:25.391479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:25.391479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:25.391479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 401/800] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:25.392014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.392014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.392014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.392213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.402675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:25.411138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:25.413037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:25.414030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:25.416537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 400/801] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:25.429094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.489849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9e0f-d3c6-4294-85b5-1b0d5a48fb8c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.524997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.525677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.525930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.526105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404842be-effe-478a-8fbc-b9bfd55df275 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.526214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.526914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:25.527248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.528618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.545559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 402/802] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:25.546485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.564136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.565100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.565588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.566014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.566881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:25.567617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.569968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.583064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 401/803] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:25.584989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.649389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb8e3-151d-4bd8-845a-bf16c20508db None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.683595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.684266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.684546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.684821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.685559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:25.685868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.687254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.693010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b448b8b-9a89-4a7f-a95f-afe9cc1c43fa None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.696849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 403/804] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:25.697399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.730831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.732007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.732485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.732943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.741302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.743137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:25.758209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:25.759204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:25.760129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:25.762440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 402/805] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:25.763433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.802771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695af7b-c3af-455d-873d-54fdd21fda33 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.836813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.837541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.837849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.838093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.845165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.846614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:25.865987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:25.867159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 404/806] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:25.868575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.876826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3b6a-124f-4954-a9f2-d149c2977a11 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:25.916449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:25.917596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:25.918081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:25.918580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:25.930625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:25.932465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:25.951327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:25.952312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:25.953198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:25.953198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:25.953198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:25.953198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:25.955824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 403/807] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:25.957043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:25.997245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d2888-ced3-4093-b12d-3a9eb7be3ba6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.040731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.041854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.042395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.042875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.043895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:26.044408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.046070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.059409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 405/808] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:26.060675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.080950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874866c3-c40e-41ff-b507-7e9d632a6dfb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.124958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.126668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.127204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.128304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.129316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:26.130001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.133378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.149147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 404/809] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:26.150089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.183937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818513-7ea6-4034-bf92-d4c975a96386 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.220569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.221231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.221527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.221792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.222507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:26.222811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.224258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.237202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 406/810] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:26.238052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.260426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414293fe-fd94-4a7c-ad2f-8a55fed2c022 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.295139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aef0d-f531-4f5b-9653-312620c5cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.296004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aef0d-f531-4f5b-9653-312620c5cf27 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.296283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aef0d-f531-4f5b-9653-312620c5cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.296553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aef0d-f531-4f5b-9653-312620c5cf27 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/15b8dc2e53bb436ab21bf6559244c7c4/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.310765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aef0d-f531-4f5b-9653-312620c5cf27 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=15b8dc2e53bb436ab21bf6559244c7c4, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.312237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aef0d-f531-4f5b-9653-312620c5cf27 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.336962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47ab4-4b6d-4602-8ccb-f76d93082083 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.370725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4386e4-5093-44d1-a592-f93a4b4d0d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.371638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4386e4-5093-44d1-a592-f93a4b4d0d3e None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.371924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4386e4-5093-44d1-a592-f93a4b4d0d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.372202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4386e4-5093-44d1-a592-f93a4b4d0d3e None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/14ec426f2eb64bb4b480b5ad42a43410/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.374166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4386e4-5093-44d1-a592-f93a4b4d0d3e None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=14ec426f2eb64bb4b480b5ad42a43410, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.375863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4386e4-5093-44d1-a592-f93a4b4d0d3e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.434528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 405/811] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:26 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/15b8dc2e53bb436ab21bf6559244c7c4/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:26.436003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a82ee-fd69-47c0-a2f6-057ec1698bcc None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.436403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a82ee-fd69-47c0-a2f6-057ec1698bcc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.436569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a82ee-fd69-47c0-a2f6-057ec1698bcc None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.437854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 406/812] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:26.440412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1deb5-3a40-4fe1-a1a6-27ede19f00bf None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.440702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1deb5-3a40-4fe1-a1a6-27ede19f00bf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.440978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1deb5-3a40-4fe1-a1a6-27ede19f00bf None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.442893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 407/813] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:26.443974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1deb5-3a40-4fe1-a1a6-27ede19f00bf None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.463092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 407/814] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:26 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/14ec426f2eb64bb4b480b5ad42a43410/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:26.464578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1d0f-f7f3-45e7-be06-10072b8d46d2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.464868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1d0f-f7f3-45e7-be06-10072b8d46d2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.465142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1d0f-f7f3-45e7-be06-10072b8d46d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.495412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b71b1d0f-f7f3-45e7-be06-10072b8d46d2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:26.496974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b71b1d0f-f7f3-45e7-be06-10072b8d46d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:26.580749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1deb5-3a40-4fe1-a1a6-27ede19f00bf None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.603141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 408/815] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:26.603141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.603141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.603141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.631516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:26.633411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:26.642050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.642861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.643180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.643459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.654341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.656463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:26.674138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:26.675214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:26.676201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 408/816] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:26.676925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.719251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 409/817] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:26.720193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.788843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4f33-952a-4da8-bce7-2352c1a35dd4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.823424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb57ce7-b2da-4b3b-b5e9-4fe5e288e026 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.826929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.827830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.828105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.828367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.829078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.830446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:26.843987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:26.845034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:26.845964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 409/818] 10.222.0.23 () {56 vars in 1129 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:26.847613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.859490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.860170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.860456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.860737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.861632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:26.861956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.863432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.882596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 410/819] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:26.887844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.949387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3a906-979e-472e-a27b-0ecd94fffbdc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.985359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.986355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.986642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.986919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] PATH_INFO: `/v3/services/network` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.987607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.988869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c0e-609b-4eb2-b100-9892d6812758 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.989047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:27.001261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:27.003581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:27.008126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 410/820] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:27.010121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.025032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.025703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.025988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.026265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.027434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:27.027746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.029594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.036152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 411/821] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:27.037021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.129792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3e49-70e1-4324-b822-48b9a2759783 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.144992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1029b3-cc75-4b0b-ad5f-df574bc16868 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.164703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.165367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.165654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.165933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.181455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.182125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.182407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.182688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.183477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] RBAC: Adding query filter params (name=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:27.183781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.185211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.190291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 412/822] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:27.191277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.239718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.241508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.303021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986fe5-0f40-4dd3-a388-7ac8e12c0758 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.338911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.339615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.339894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.340166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.340869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:27.341171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.342528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.345050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 411/823] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:57:27.345913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.352868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 413/824] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:27.353891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.450165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5313b71-b956-4788-9041-372eb6422fe3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.457204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c408a0-e194-4630-8028-7186c0045876 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.485805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.486633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.486919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.487548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.488541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] RBAC: Adding query filter params (type=network) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:27.488860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.490383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.492480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.493467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.493894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.494320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.495901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 412/825] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:27.496741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.506206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.508137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:27.527294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:27.528471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:27.529476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:27.529476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:27.529476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:27.529476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:27.531357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 414/826] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:27.532380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.601175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696fdff-1cd8-4dc0-8e2a-e33905912800 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.635994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1c58-e2fe-49d3-8eee-ee3c3ca7fda4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.636961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.637630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.637917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.638260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.639040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.640407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.674246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.674916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.675239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.675506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.676264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.677774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.744141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 413/827] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:27.744141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:27.763996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 415/828] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:27.897525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0802a-143e-44c2-9708-6cd01b400657 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:27.941022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:27.941706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:27.941992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:27.942517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:27.943892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:27.944245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:27.945727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:27.959480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 414/829] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:27.964781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:28.114420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6898e8-eaa8-4808-bfea-43f83d434148 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:28.155512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:28.156330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:28.156620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:28.156899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:28.165782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:28.167279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:28.183995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:28.184946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:28.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 416/830] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:28.190879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:28.316926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaac339-2536-415b-a1e8-05a92fc31701 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:28.352066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:28.352729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:28.353014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:28.353291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:28.354082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:28.354392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:28.355852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65a399-980e-457b-af0c-049af57c79b9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:28.369071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 415/831] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:28.374805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:28.480609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087045-034d-4590-a5f5-686ae874cd06 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:28.514939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:28.515646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:28.515932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:28.516206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:28.517036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=a8eeb8fcc242428cb31dc31e25e7865f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:28.517347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:28.518787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de12235-6241-40c5-ac06-14852c6ae3ff None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:28.526256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 417/832] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:28 2022] GET /identity/v3/role_assignments?user.id=a8eeb8fcc242428cb31dc31e25e7865f&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:28.912068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336483a-f2de-413a-ae66-0405ea0bf96f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:28.912724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336483a-f2de-413a-ae66-0405ea0bf96f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:28.912724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336483a-f2de-413a-ae66-0405ea0bf96f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:28.914320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 416/833] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:28.919398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:28.919880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:28.920040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:28.938084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:28.939298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:28.996752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be93751-1c27-4ce8-8dea-456b10ba7d0b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:28.997395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be93751-1c27-4ce8-8dea-456b10ba7d0b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:28.997894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be93751-1c27-4ce8-8dea-456b10ba7d0b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.000734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 417/834] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:29.005064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.005625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.006107 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.015093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 418/835] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:29.023905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:29.025378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:29.034462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.109094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 418/836] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:29.133388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.159106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11df7-c883-4312-839f-d49d15a79d46 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.203737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.204461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.204731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.205008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.218582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:29.231349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:29.233650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:29.235514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 419/837] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:29.238293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.260788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97432098-7022-4d67-aafa-14798f5aeb5a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.304383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.305884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.306343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.307068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.322383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:29.332171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:29.333832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:29.340830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 419/838] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:29.344405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.360686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c76d-207a-49eb-94c1-4dc593c651f2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.405611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.406292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.407056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.407338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.408368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:29.408676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:29.410592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:29.422106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 420/839] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:29.426747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.467655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be624ee-44df-4716-9a89-0cfd6399268d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.510537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.511334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.511691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.512031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.512850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:29.513222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:29.515133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:29.528215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 420/840] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:29.533367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.545436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0374ddb-dd71-4d60-878c-489f075dd44f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.590511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.591366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.591648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.591921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.604722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:29.605838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:29.623732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:29.624888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:29.625862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:29.625862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:29.625862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:29.625862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:29.625862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 421/841] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:29.632455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.647581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117e72-ecee-4182-854d-7cf66f0c0120 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.688835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.690431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.690878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.691707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.706191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:29.708425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:29.731243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:29.732368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:29.733482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:29.733482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:29.733482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:29.733482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:29.736392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 421/842] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:29.743769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.757381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785773e-6429-4caf-9e95-7348739362f1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.795501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.796554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.797504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.798011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.799328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:29.799859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:29.802088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:29.824450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 422/843] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:29.826472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.867584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe9d2-7f51-4819-a7c5-1198a03ccd7f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.902136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.902816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.903315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.903447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:29.904109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:29.904415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:29.905854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:29.924114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 422/844] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:29.925546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.964021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff4700-a834-4b9e-b3ef-bae052fecc5a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.005557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.006926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.007497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.008050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.017814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.019826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.027659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbc402-0f40-49f4-91e1-e3fe87f684fc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:30.037793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:30.038787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:30.039807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:30.046764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 423/845] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:30.047878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.063241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.064091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.064372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.064690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.072632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.073986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:30.089535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:30.090555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:57:30.091601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:30.095903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 423/846] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:57:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:30.096922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.164343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce997d-6f06-4f30-8ffe-44f63825f998 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.205730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.208494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.208494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.208747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.209942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:30.210259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.212082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.218189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bff252-89b7-4150-8153-8128b510eb7f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.236668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 424/847] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:30.237603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.257164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.258314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.258801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.259408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.260478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:30.261008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.262701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.287385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 424/848] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:30.289263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.343454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c3337-7026-4254-b7c5-8503bcfa33dd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.378709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8299a1-4c26-4bd4-93cc-4b98e9c0a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.379400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8299a1-4c26-4bd4-93cc-4b98e9c0a729 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.379686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8299a1-4c26-4bd4-93cc-4b98e9c0a729 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.379968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8299a1-4c26-4bd4-93cc-4b98e9c0a729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.388538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8365b-c9ac-4f98-aba4-e58972550154 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.424240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da1458-8a58-43c4-b12f-0f771f250967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.424921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1458-8a58-43c4-b12f-0f771f250967 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.425200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1458-8a58-43c4-b12f-0f771f250967 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.425471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1458-8a58-43c4-b12f-0f771f250967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.453649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8299a1-4c26-4bd4-93cc-4b98e9c0a729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.455201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8299a1-4c26-4bd4-93cc-4b98e9c0a729 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.495002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da1458-8a58-43c4-b12f-0f771f250967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.496463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da1458-8a58-43c4-b12f-0f771f250967 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.555986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 425/849] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:57:30.561752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a099d2e-3087-4e7a-a0b7-9f22b0c9b30b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.562054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a099d2e-3087-4e7a-a0b7-9f22b0c9b30b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.562325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a099d2e-3087-4e7a-a0b7-9f22b0c9b30b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.567240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 426/850] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:30.567240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a099d2e-3087-4e7a-a0b7-9f22b0c9b30b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.599652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 425/851] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:57:30.604021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.604021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.604021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.619221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:30.620398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:30.674446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a099d2e-3087-4e7a-a0b7-9f22b0c9b30b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.687292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 426/852] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:30.688146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.730040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.731286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.731809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.732279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.744309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.745798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:30.763476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:30.764416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:30.765969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:30.765969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:30.765969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:30.765969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:30.765969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 427/853] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:30.765969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.795889 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8b6e-2acf-4d32-a8ec-7187f56feefa None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.832342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.833758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.834032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.834287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.844923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.846498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:30.865537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:30.866511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:30.867439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:30.867439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:30.867439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:30.867439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:30.867439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 427/854] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:30.867722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.879967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9a28f-9fd3-4ab8-bdd2-91fb0035e0fb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.916083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.916909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.917190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.917471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.918129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.919555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:30.931595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:30.932694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:30.933538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 428/855] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:30.935040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.972018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93896e-3594-498b-ae66-2c8b3de1b544 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.005965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.006677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.006959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.007258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.007967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.008349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.009687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7a9e8-50a4-43e3-b401-167bd6b369e7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.021310 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 428/856] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.022824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64fc2-5582-40f6-88ea-6c07f920db99 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.023297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64fc2-5582-40f6-88ea-6c07f920db99 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.023764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64fc2-5582-40f6-88ea-6c07f920db99 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.025204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 429/857] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:31.026155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64fc2-5582-40f6-88ea-6c07f920db99 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.033906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e4c71-7fe6-48fb-a562-02108f511c95 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.076243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.076914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.077202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.077478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.078197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.078507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.079909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.092946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 429/858] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.093740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.127624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64fc2-5582-40f6-88ea-6c07f920db99 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.160617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.161330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.161629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.161906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.162788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.163129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.164483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431d21-2fc2-40b1-b755-3a7af7cbfefd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.168886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 430/859] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.170165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.170462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.170748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.186808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:31.188029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:31.192162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219e4d4-d849-45cf-bd1d-3a8b99e04a80 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.229119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.229906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.230185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.230454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.236948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.238374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:31.251644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:31.252545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:31.253536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:31.253994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 431/860] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:31.253994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.257012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 430/861] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:31.257012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.354314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d214-ddd3-4832-920d-ed0704b3694c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.354532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea428-064f-4318-bc86-a42815aa8e7e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.386836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.387075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.387531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.387652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.387816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.387926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.388093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.388186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.388794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.389100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.390462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.394891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.395321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 431/862] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.396382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.397475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:31.411039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:31.413181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:31.414132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.510076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bea566-b6c9-4c54-946d-9db3bfd3b5b4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.539152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933490-b220-4c41-88cc-88003e867f9f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.545730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.546404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.546696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.546972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.547790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.548100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.549586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.568322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 432/864] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.568322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.581999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.583048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.583710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.584754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.586125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:31.603069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:31.604251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:31.605189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 433/865] 10.222.0.23 () {56 vars in 1132 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:31.606041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.687678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99bc83-8589-4f71-bcc2-033500ca5737 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.711724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1551c7-695b-414b-a354-f364787d0ace None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.722354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de450271-19b1-4d67-889c-78f875307820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.723040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de450271-19b1-4d67-889c-78f875307820 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.723333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de450271-19b1-4d67-889c-78f875307820 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.723610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de450271-19b1-4d67-889c-78f875307820 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.724694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de450271-19b1-4d67-889c-78f875307820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.725203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de450271-19b1-4d67-889c-78f875307820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.726643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de450271-19b1-4d67-889c-78f875307820 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.738546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 433/866] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.739931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de450271-19b1-4d67-889c-78f875307820 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.755240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.755906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.756190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.756462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.757299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=15b8dc2e53bb436ab21bf6559244c7c4) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.757612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.759102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.765124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 434/867] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/role_assignments?user.id=15b8dc2e53bb436ab21bf6559244c7c4&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.765933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.863100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de450271-19b1-4d67-889c-78f875307820 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.898829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.899693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.899980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.900257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.900969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.901273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.902660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.904605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3746c-2461-4311-9850-82c1ecd97497 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.912244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 434/868] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:31.917910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.952901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.953973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.954472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.954967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.956049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=14ec426f2eb64bb4b480b5ad42a43410) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:31.956570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.958376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66413d-e730-49b1-b5da-c3d128842373 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.966324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 435/869] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/role_assignments?user.id=14ec426f2eb64bb4b480b5ad42a43410&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:32.041100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658378c5-883e-454e-b31d-9f1d7053ff38 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:32.080960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:32.081998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:32.082506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:32.083030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:32.083994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:32.084515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:32.086134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45464bc0-27e0-43b9-b7ad-8a5b6561a1ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:32.092169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 435/870] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:33.701104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c738e-55cf-4536-a62f-73452c8cf223 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:33.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c738e-55cf-4536-a62f-73452c8cf223 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:33.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c738e-55cf-4536-a62f-73452c8cf223 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:33.703321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 436/871] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:33.709395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541982-8eae-4816-92d9-1fcb7f15cfb3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:33.709917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541982-8eae-4816-92d9-1fcb7f15cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:33.710155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541982-8eae-4816-92d9-1fcb7f15cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:33.728681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-72541982-8eae-4816-92d9-1fcb7f15cfb3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:33.729979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-72541982-8eae-4816-92d9-1fcb7f15cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:33.798999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 436/872] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:33.822193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c738e-55cf-4536-a62f-73452c8cf223 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:33.930178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c738e-55cf-4536-a62f-73452c8cf223 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:33.966263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d9a0-4784-48e2-80f3-11ec7cca1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:33.966851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d9a0-4784-48e2-80f3-11ec7cca1c66 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:33.967165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d9a0-4784-48e2-80f3-11ec7cca1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:33.967439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d9a0-4784-48e2-80f3-11ec7cca1c66 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:33.968171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d9a0-4784-48e2-80f3-11ec7cca1c66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:33.969526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d9a0-4784-48e2-80f3-11ec7cca1c66 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:34.064048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 437/873] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:33 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:34.242430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc06c3-4e25-415a-9035-509a5f4d5b5a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.242793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc06c3-4e25-415a-9035-509a5f4d5b5a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.243222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc06c3-4e25-415a-9035-509a5f4d5b5a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.245094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 437/874] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:34.251029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.251452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.251832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.272341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:34.273730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:34.349234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 438/875] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:34.367764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c7a8f-ffa1-4acb-b54f-25d249253d6b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.368065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c7a8f-ffa1-4acb-b54f-25d249253d6b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.368320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c7a8f-ffa1-4acb-b54f-25d249253d6b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.369910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 438/876] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:34.372527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:34.375320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e135e0-7eb3-428e-b105-cd7fd6c8f2cb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.375609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e135e0-7eb3-428e-b105-cd7fd6c8f2cb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.375888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e135e0-7eb3-428e-b105-cd7fd6c8f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.393531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-17e135e0-7eb3-428e-b105-cd7fd6c8f2cb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:34.395097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-17e135e0-7eb3-428e-b105-cd7fd6c8f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:34.472323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 439/877] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:34.472323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adcf90-d3f5-4329-b1b4-54d364dd2c2e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.472323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adcf90-d3f5-4329-b1b4-54d364dd2c2e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.472323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adcf90-d3f5-4329-b1b4-54d364dd2c2e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.477981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 440/878] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:34.480006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.480299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.480734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.487090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bfe08-78a5-453d-a65d-ca77671ae9db None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:34.513055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:34.513055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:34.522821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:34.523672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.523949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.524220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.534899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:34.544189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:34.545163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 439/879] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 17:57:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:34.551404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:34.591384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 441/880] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:34.592237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:34.659667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcacb3-3b2e-4bb2-899e-77e8943c5860 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:34.694566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73149268-1cd4-4b44-8928-39de80400cf0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:34.694761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:34.695342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.695625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.695891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.696702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:34.698064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:34.728455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:34.729281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.729487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.729763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.730591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:34.730899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:34.732300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:34.741271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 442/881] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:57:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:34.742114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:34.811036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 440/882] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:34 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:34.811036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:34.863242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28024bfa-93e0-4933-a5cd-d7a57f2fe2dc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:34.909092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:34.910181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.910630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.911801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.913099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:34.914784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:34.927897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7a11-aef6-487f-ab8b-d7acd61e0ae1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:34.934864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:34.936174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:34.937209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:34.939699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 443/883] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:34.946692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:34.973762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:34.974932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:34.975419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:34.975911 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:34.988169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:34.990045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:35.009647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:35.010609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:35.011533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:35.011533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:35.011533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:35.011533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:35.012532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 441/884] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:35.017939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:35.064081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee05b9-1e2a-47da-a85c-6b974fc8f2bc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:35.099139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:35.099810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:35.100090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:35.100363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:35.101068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:35.101418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:35.102781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.112199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 444/885] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:35.114294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:35.139820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ec13-13b8-45c4-a29c-0247a30ecdef None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:35.173640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:35.174307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:35.174585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:35.174884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:35.175656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:35.175901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:35.177447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.192561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 442/886] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:35.197809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:35.247325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ea4d8-9781-4f94-953c-1ff88db44e36 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:35.282508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:35.283259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:35.283541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:35.283817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:35.284524 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:35.285119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:35.286313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.291932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 445/887] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:35.316157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d63f-8e8c-4a8d-9a96-ca7b03363f42 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:35.354368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:35.355275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:35.355562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:35.355834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:35.364895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:35.366346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:35.382705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:35.383750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:35.385139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 443/888] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:57:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:35.390078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:35.499034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29912053-663a-4afa-83c7-f2c5cb219726 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:35.537761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:35.538439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:35.538719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:35.539011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:35.539857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:35.540166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:35.541613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.560141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 446/889] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 17:57:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:35.565706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:35.678815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e6412-49bf-49d0-926d-cf74a1b8a0b0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:35.716189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:35.717240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:35.717740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:35.718244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:35.789566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:35.791393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:35.893188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 444/890] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:57:35.900054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.014453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2ffa3-f272-4a7f-80cf-6e4b86affd43 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.052629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.053813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.054330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.054809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.071021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.071021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:36.086029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:36.086980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:36.087931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:36.087931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:36.087931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:36.087931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:36.087931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 447/891] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:36.094261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.216391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d212904-337b-4778-abab-51b21accd0b7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.255418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.256301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.256596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.256908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.257692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:36.258014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.259477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951899e-12f1-4c83-8f3f-ced8df182967 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.274428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 445/892] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:36.280349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.384375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b408-9395-48fd-9831-c95b60a7f2c6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.419730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.420592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.420875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.421148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.428445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.429908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:36.445146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:36.446317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:36.447713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 448/893] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:36.448214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ea2b-135c-4bd1-9e28-e969c9738d3f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.448214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ea2b-135c-4bd1-9e28-e969c9738d3f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.448214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ea2b-135c-4bd1-9e28-e969c9738d3f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.449396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 446/894] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:36.454424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.454719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.455033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.457192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.474392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:36.475637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:36.568220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 447/895] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:36.574760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de77d-aea9-4c6b-b427-0a25e37e9eae None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.591690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.610231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.610900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.611211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.611494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.612281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:36.612594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.614657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.633716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 449/896] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:36.635172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.704996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127de74c-4870-4477-a50e-ec6abc3e00ec None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.741398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1fcf5-1b65-4b06-a0c3-a9c7df9fefa1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.742927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.743990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.744478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.744956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.745929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.747571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:36.760755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:36.761815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:36.762656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:36.770857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 448/897] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:36.772103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:36.778489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.779193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.779478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.779810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.780734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] RBAC: Adding query filter params (role.id=be3eec78c99b4b8eb1281e711cfc6983, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=15b8dc2e53bb436ab21bf6559244c7c4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:36.781048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.782525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.795035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 450/898] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/role_assignments?user.id=15b8dc2e53bb436ab21bf6559244c7c4&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=be3eec78c99b4b8eb1281e711cfc6983 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:36.890758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465acda-90b3-4e52-b180-78bd61fc0d46 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:36.928483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:36.929262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:36.929448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:36.929730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:36.930451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:36.930759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:36.932185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:36.938086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 449/899] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:36.944680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.057248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f646da-1eea-4132-ad6a-4eefe5eed07f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.093333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.094280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.094717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.095185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.096047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:37.096500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.098007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3825e77-a23c-475d-8588-17255330b49a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.104409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 451/900] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:37.110214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.172242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407d46-7170-4a6b-9851-f62a096a2d65 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.172613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407d46-7170-4a6b-9851-f62a096a2d65 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.172992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407d46-7170-4a6b-9851-f62a096a2d65 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.174713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 452/901] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:37.180654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.181046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.181446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.202068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:37.203468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:37.216913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf2a06-2e07-4ec8-b30d-1a64bd29d96e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.255409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.256494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.256780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.257057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.258129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] RBAC: Adding query filter params (interface=public, service_id=5cde6f3464864415bdea0158461ce0a5, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:37.258444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.260462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.267270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 450/902] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:37 2022] GET /identity/v3/endpoints?service_id=5cde6f3464864415bdea0158461ce0a5&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:37.273598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.295421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 453/903] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:37.318782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.400354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6287d-c77d-4539-80b6-639bc3bd4d59 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.420196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac1db-50d0-468f-9f80-ae97ed4a99e2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.447184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.448383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.448861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.449755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.451329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.454832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.461950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.463011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.467036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.467192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 451/904] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:37 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:37.474196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.474196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.474196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:37.485946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:37.487205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:37.488042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:37.490833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 454/905] 10.222.0.23 () {56 vars in 1132 bytes} [Wed May 4 17:57:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:37.496472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.615249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e32e4-c456-44d8-8ca2-2815a955c48a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.655084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.656134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.656604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.657055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.658073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:37.658588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.660261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c99b7-8f1f-4541-8960-42e1bbe5c0ed None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.666282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 452/906] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:37.671557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.732036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24969da2-a205-4930-9eb0-50f3cd8a6195 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.732605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24969da2-a205-4930-9eb0-50f3cd8a6195 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.732890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24969da2-a205-4930-9eb0-50f3cd8a6195 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.734386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 453/907] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:37.741622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.741908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.742193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.760457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:37.761654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:37.786856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b828-3aa2-459b-b6e1-c86ecd1057ad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.822020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.823098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.823580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.824048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.824944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:37.825444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.827040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.832993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 455/908] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:37.842219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 454/909] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:37.842399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.861801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:37.950736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05385a-72d9-42a2-83fa-0707d1f9f13d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.970685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3725b8-0495-4254-ba0a-2da47efe95e3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:37.987803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:37.988415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:37.989367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:37.989744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:37.990655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] RBAC: Adding query filter params (interface=public, service_id=a419b16962464d9690cd60bf0c8f7c2c, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:37.991094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:37.992702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:37.998574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 456/910] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:37 2022] GET /identity/v3/endpoints?service_id=a419b16962464d9690cd60bf0c8f7c2c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:38.003780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:38.019213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af72c-47f9-4e00-b37c-d05990a1abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:38.020219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af72c-47f9-4e00-b37c-d05990a1abee None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:38.020895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af72c-47f9-4e00-b37c-d05990a1abee None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:38.021510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af72c-47f9-4e00-b37c-d05990a1abee None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:38.022298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af72c-47f9-4e00-b37c-d05990a1abee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:38.023705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af72c-47f9-4e00-b37c-d05990a1abee None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:38.112965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7315-d4a3-4496-a836-bc7421decee3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:38.124095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 455/911] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:37 2022] POST /identity/v3/services => generated 241 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:38.172351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc935-2321-4201-85c6-b1b96e33699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:38.173468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc935-2321-4201-85c6-b1b96e33699d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:38.173961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc935-2321-4201-85c6-b1b96e33699d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:38.174505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc935-2321-4201-85c6-b1b96e33699d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:38.175578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccc935-2321-4201-85c6-b1b96e33699d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:38.178472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccc935-2321-4201-85c6-b1b96e33699d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:38.186447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 457/912] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:38 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:39.220818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b092f-3a97-4389-843b-b79933346a64 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:39.222325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b092f-3a97-4389-843b-b79933346a64 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:39.223733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b092f-3a97-4389-843b-b79933346a64 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:39.227125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 456/913] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:39.232751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:39.233629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:39.234120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:39.251807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:39.253370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:39.325430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 458/914] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:39.348941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b092f-3a97-4389-843b-b79933346a64 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:39.480684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b092f-3a97-4389-843b-b79933346a64 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:39.516556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:39.517737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:39.518224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:39.518716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:39.530212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:39.539085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:39.540025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:39.540886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:39.543605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 457/915] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 17:57:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:39.549853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:39.653555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89127b2b-f2c9-4b17-bbbd-b224feb41e4e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:39.690850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:39.693026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:39.693527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:39.694037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:39.695018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:39.695531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:39.697339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:39.706064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 459/916] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:57:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:39.712283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:39.819223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718d28-1b34-4e11-8502-d8cb58175bff None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:39.859478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:39.860719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:39.861226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:39.861715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:39.874182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:39.875965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-851391a4-df9e-4dab-8ff9-0c11213c8d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:39.894366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:39.896289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:39.897302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:39.897302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:39.897302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:39.897302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:39.899631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 458/917] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:39.908132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.011394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62176b8-ee68-4844-97a3-9bc1e7efc7b9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.033935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995c9e2-e8ad-4ac2-b7ea-3630c9948161 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.034558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995c9e2-e8ad-4ac2-b7ea-3630c9948161 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.035096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995c9e2-e8ad-4ac2-b7ea-3630c9948161 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.038123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 459/918] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:40.043714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.044273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.044794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.046926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.047621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.047909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.048188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.048914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:40.049223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.050602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.064360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:40.065921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:40.067231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 460/919] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:40.071243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.147088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 460/920] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:40.164873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.173498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a8dc-5ba6-4c40-8355-aa5d5e499ee9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.216607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.217452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.217924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.218205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.226467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.228113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:40.244629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:40.246052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:40.247030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 461/921] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:40.252273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.276943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3110-4726-4e12-989b-ba4bbba6628b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.314764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.315659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.316280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.316454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.317156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.318691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:40.332200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:40.333709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:40.334608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 461/922] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:40.344532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.387553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671803-a4d0-4be2-a25b-9c7afa9402f0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.440193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.440884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.441419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.441855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.443073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:40.443405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.445385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.468764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 462/923] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:40.474812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.484153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f854-1d32-47de-891a-8fb02cbe24c9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.523256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.523927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.524211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.524493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.525196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:40.525503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.526860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c5a52-6648-4828-a7ca-4a79d9a2c5fd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.531607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 462/924] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:40.532819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c730d-fe62-4ab2-b285-7490b22e8259 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.533122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c730d-fe62-4ab2-b285-7490b22e8259 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.533380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c730d-fe62-4ab2-b285-7490b22e8259 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.535026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 463/925] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:40.537858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c730d-fe62-4ab2-b285-7490b22e8259 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.588412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bd19-e975-4b7e-ab98-f88ec63afdec None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.622576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.623404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.623693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.623969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.634628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.636121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.639794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c730d-fe62-4ab2-b285-7490b22e8259 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0db3ccf9-6b08-4e8f-a94f-8d42aac3262a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:40.654141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:40.655140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:40.656035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:40.656035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:40.656035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:40.656035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:40.656035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 463/926] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:40.656737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.657026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.657310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.674206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:40.675424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:40.677872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.678539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.678821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.679135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.679834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:40.680141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.681492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c658b85-dea6-4791-aad3-6528dc0da741 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.686199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 464/927] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:40.687638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992631e1-5d5b-46ed-b903-17d582c316d1 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.687926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992631e1-5d5b-46ed-b903-17d582c316d1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.688205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992631e1-5d5b-46ed-b903-17d582c316d1 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.689545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 465/928] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:40.692037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992631e1-5d5b-46ed-b903-17d582c316d1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.741001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 464/929] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:40.741835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.792630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992631e1-5d5b-46ed-b903-17d582c316d1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.824955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.825619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.825905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.826190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.826916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:40.827257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.828639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630691a1-cbd2-403d-969f-0e7f51ed5bd4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.841598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 466/930] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:40.842808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.843125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.843406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.852026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138bf16-0161-4395-8d73-286d9be162bd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:40.859753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:40.860942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:40.886172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:40.886835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:40.887153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:40.887435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:40.888400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:40.889570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:40.926262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 467/931] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:40.927134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:40.973395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 465/932] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:40.974291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.031418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6a30-9514-4fb1-bd88-1c47d6250359 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.075131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.075968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.076252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.076529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.077268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.078718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.085131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd171-68f6-4219-aa13-4bc83271e89c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:41.091485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:41.092622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:41.093518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 468/933] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:41.094328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.121570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.122432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.122726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.123024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.131087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.132566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:41.147920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:41.149029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:41.149950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 466/934] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:41.150849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.215746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd38a9-36a0-4a33-828c-86d1f0ae9489 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.249331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.250484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.251001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.251379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.252054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.253387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.253829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a339-cfd7-4f3c-871b-a4087c012c7b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:41.266002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:41.267024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:41.268473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 469/935] 10.222.0.23 () {56 vars in 1132 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:41.269312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.292910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.293952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.294420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.294760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.295502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:41.295805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.297158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.307248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 467/936] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:41.307248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.369882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbf73f-0317-4ae4-b742-fdb9ff5d6330 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.400944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82a15d-e683-4cf2-8a8e-95a3139c112d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.403308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.403963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.404245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.404517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.405294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:41.405896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.407152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.419630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 470/937] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:41.420476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.436285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.437322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.437681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.437964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.438673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:41.438996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.440386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.450931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 468/938] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:41.450931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.527792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa46f-8f2a-4c7a-bf4c-458544874c14 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.554504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba101c1-74ca-41d7-8f9c-9a8c22b1d272 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.563277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.564030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.564486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.564765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.565477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:41.565779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.568316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.573771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 471/939] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:41.574577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.590780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.591750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.592106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.592389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/15b8dc2e53bb436ab21bf6559244c7c4/roles/be3eec78c99b4b8eb1281e711cfc6983` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.594636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=15b8dc2e53bb436ab21bf6559244c7c4, role_id=be3eec78c99b4b8eb1281e711cfc6983)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.596109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.682278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06fb0-397d-4cf8-8798-77e8b11016eb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.699851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 469/940] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:57:41 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/15b8dc2e53bb436ab21bf6559244c7c4/roles/be3eec78c99b4b8eb1281e711cfc6983 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:41.712152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.723728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.724848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.725487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.725982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.727026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:41.727612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.729387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.735917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 472/941] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:41.742039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.847528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e765dc-e6e7-45f7-9299-a1bc60615733 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.866082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d418-0df0-4875-806c-f405ad9de0d6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:41.888058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.888898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.889252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.889599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.890566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] RBAC: Adding query filter params (interface=public, service_id=c777511dcdf6400fbc05abf64adf6ea9, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:41.890897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.892415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:41.899633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 470/942] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/endpoints?service_id=c777511dcdf6400fbc05abf64adf6ea9&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:41.905162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:41.908621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c107be-a6ed-401c-8f63-77fcc6ed2f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:41.908621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c107be-a6ed-401c-8f63-77fcc6ed2f63 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:41.908845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c107be-a6ed-401c-8f63-77fcc6ed2f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:41.908918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c107be-a6ed-401c-8f63-77fcc6ed2f63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:41.909671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c107be-a6ed-401c-8f63-77fcc6ed2f63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:41.911906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c107be-a6ed-401c-8f63-77fcc6ed2f63 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:42.005803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 473/943] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:42.011260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7f453-d6e6-43a7-b339-ed4673a9d32d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:42.059572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcb040-3d29-449e-b8a5-8ee1fa2f161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:42.060290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcb040-3d29-449e-b8a5-8ee1fa2f161d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:42.060575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcb040-3d29-449e-b8a5-8ee1fa2f161d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:42.060849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcb040-3d29-449e-b8a5-8ee1fa2f161d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:42.061574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcb040-3d29-449e-b8a5-8ee1fa2f161d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:42.063048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcb040-3d29-449e-b8a5-8ee1fa2f161d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:42.070972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 471/944] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:41 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:57:43.400684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3484a4-7583-4c42-a3bc-630ff8f06239 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:43.401200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3484a4-7583-4c42-a3bc-630ff8f06239 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:43.401279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3484a4-7583-4c42-a3bc-630ff8f06239 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:43.402840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 474/945] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:43.408129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:43.408563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:43.408700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:43.426883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:43.428085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:43.496770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 472/946] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:43.519349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3484a4-7583-4c42-a3bc-630ff8f06239 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:43.629616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3484a4-7583-4c42-a3bc-630ff8f06239 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:43.664830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:43.665500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:43.665780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:43.666054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:43.666774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:43.668233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:43.669602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING keystone.server.flask.common [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 17:57:43.730333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.sql.core [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 17:57:43.730333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 17:57:43.730333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [parameters: {'id': '58d0e015d375489d985297b6bc54dd53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 17:57:43.730333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80416) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 58d0e015d375489d985297b6bc54dd53.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 58d0e015d375489d985297b6bc54dd53. May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:57:43.738326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 17:57:43.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application yield resource May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.rollback() May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.force_reraise() May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise self.value May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application session.commit() May 04 17:57:43.742470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._prepare_impl() May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.flush() May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._flush(objects) May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application compat.raise_( May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application flush_context.execute() May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 17:57:43.744728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rec.execute(self) May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 17:57:43.746897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:57:43.748858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [parameters: {'id': '58d0e015d375489d985297b6bc54dd53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:43.751014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:43.752955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 58d0e015d375489d985297b6bc54dd53. May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:43.755370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 475/947] 10.222.0.23 () {60 vars in 1140 bytes} [Wed May 4 17:57:43 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:43.756654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:43.852413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ba7f-a457-4e94-bac2-e576a760837f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:43.891242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:43.892068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:43.892351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:43.892627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:43.901373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:43.902963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-da29933a-407e-4d63-b4e3-a7aaabd2c6dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:43.918763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:43.920941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:43.923108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 473/948] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:43.928674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.035832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95308-0bd9-48a3-91d6-b03b98dcf5bf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.070627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.071320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.071605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.071882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.072644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:44.072953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.074642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.085382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b919a10-b66d-4590-a222-39660714450e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.085382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b919a10-b66d-4590-a222-39660714450e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.085382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b919a10-b66d-4590-a222-39660714450e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.085382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 474/949] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:44.092997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4bb67-107e-4247-94d9-209bc8dce8eb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.092997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4bb67-107e-4247-94d9-209bc8dce8eb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.092997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4bb67-107e-4247-94d9-209bc8dce8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.098858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 476/950] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:44.114235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cfa4bb67-107e-4247-94d9-209bc8dce8eb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:44.115936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cfa4bb67-107e-4247-94d9-209bc8dce8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:44.196924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 475/951] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:44.221461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.333305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01fb7d-38a4-482c-a614-df9d1c736649 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.370275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.371186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.371473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.371749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.383456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:44.387766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06a4b5-05d5-4a9b-b06f-b1163717a452 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.388297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06a4b5-05d5-4a9b-b06f-b1163717a452 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.388780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06a4b5-05d5-4a9b-b06f-b1163717a452 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.390690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 476/952] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:44.391857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:44.397807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.399350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 477/953] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:44.400112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.400911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6abfc-9247-4c21-a05a-4e0a630368e3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.401401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6abfc-9247-4c21-a05a-4e0a630368e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.401881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6abfc-9247-4c21-a05a-4e0a630368e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.420077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-25d6abfc-9247-4c21-a05a-4e0a630368e3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:44.421999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-25d6abfc-9247-4c21-a05a-4e0a630368e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:44.491470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 477/954] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:44.492799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd733-1dbe-4fdc-85fd-0ad54e2b393b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.493090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd733-1dbe-4fdc-85fd-0ad54e2b393b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.493366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd733-1dbe-4fdc-85fd-0ad54e2b393b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.494864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 478/955] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:44.503259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa9276-50bc-48f2-bc96-4c722e519484 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.505019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.505403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.505781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.522608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:44.523957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:44.540321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.540985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.541266 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.541541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.542286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:44.542590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.543997 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.557632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 478/956] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:44.557632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.591924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 479/957] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:44.593091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.653046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f04fbc-14e6-4f52-a017-9a356d9ed34f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.685206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.685995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.686274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.686635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.687212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.688588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.697319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c5442-ee3d-4b7b-8fe1-cd10faaef3e7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:44.700819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:44.701814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:44.702645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.707492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 479/958] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:44.708410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.732115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.732912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.733195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.733476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.744035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.745686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:44.764176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:44.765161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:44.766044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:44.766044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:44.766044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:44.766044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:44.766044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 480/959] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:44.766330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.814299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b1619-318d-4938-a4e8-416b92112ec4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.852800 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.854318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.854778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.855257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.856101 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.858068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.869936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f48e0-0895-4687-94fd-c3d830fadb0e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:44.872652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:44.873616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:44.874500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:44.876669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 480/960] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:44.877599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.909775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.910601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.910882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.911196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.911904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:44.912210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.913574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.918205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 481/961] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:44.923444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.986411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8994f-7ed3-4c39-83c5-f7041140e413 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.021222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.021928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.022213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.022492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.023267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:45.023579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.024938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.027346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98b0dd-e74d-47a2-abdb-322d126e86ca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.037842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 481/962] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:45.038702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.067533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.068311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.068568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.068839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.069534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:45.069837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.071219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.080818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 482/963] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:45.080818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.146378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba1e2-6c17-4339-baf7-b0427615cb0d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.179570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8b71d-e163-4940-8d22-e1a8d0f976e8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.180579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.181242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.181521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.181791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.182495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:45.182802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.184235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.199216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 482/964] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:45.200612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.229674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.230673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.231105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.231457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.241088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.242673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:45.260342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:45.261372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:57:45.262325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:45.266548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 483/965] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:57:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:45.267994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.333118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49366dbc-55a4-4be9-a780-c731bae57d89 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.371956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.372951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.373475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.373968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.374900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:45.375444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.377017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.383718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 483/966] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:45.388593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45620698-bbc0-4d45-be65-8ec9d470ab97 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.389761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.442944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.444529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.445026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.445512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.446553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:45.447176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.448818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.473179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 484/967] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 17:57:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:45.474752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.500979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850f79-7094-42eb-b805-9e2ee7325ad4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.539748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.540412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.540687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.540971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.541733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.543131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.579669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d117-3e14-4768-b8be-eca2e4e9e24e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.615411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.616070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.616350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.616704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.625775 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 484/968] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:45.698906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.700772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.814184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 485/969] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:57:45.820437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.938867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe52a7e-e079-4017-8bc7-12a700d50323 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.974154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.974873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.975185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.975463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.986937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.988952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:46.007553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:46.008701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:46.009700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:46.009700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:46.009700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:46.009700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.013449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 485/970] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:46.014830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.117494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95381f01-3255-4c52-801f-bfcd8b3a6efb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.152421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.153090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.153371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.153649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.154470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:46.154779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:46.156181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.173141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 486/971] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:46.174491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.281626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d99b4-e057-467f-b296-61801a3cca9c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.319201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.320008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.320290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.320568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.327791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:46.329222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-40d04be7-4635-421f-a749-67ba51d80a73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:46.343628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:46.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:46.349013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.350061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 486/972] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:46.355016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.458744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef7bd0-f2e9-4acb-8869-66fbad38a733 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.466565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d2fc-86d9-4df0-b9c4-4e7a58fdf02e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.466880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d2fc-86d9-4df0-b9c4-4e7a58fdf02e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.467167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d2fc-86d9-4df0-b9c4-4e7a58fdf02e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.468810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 487/973] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:46.475414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.475751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.475975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.492807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:46.494316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:46.496450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.497920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.498210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.498490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.499322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:46.499631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:46.501142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.519621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 487/974] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:46.524689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.575216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 488/975] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:46.593364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.647904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3abe-2c5b-4255-9f09-eb62fb843e67 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.684009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.684830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.685124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.685401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.686719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] RBAC: Adding query filter params (role.id=be3eec78c99b4b8eb1281e711cfc6983, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=15b8dc2e53bb436ab21bf6559244c7c4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:46.686941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:46.688790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.699035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 488/976] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:46 2022] GET /identity/v3/role_assignments?user.id=15b8dc2e53bb436ab21bf6559244c7c4&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=be3eec78c99b4b8eb1281e711cfc6983 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:46.717209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd941-d09f-4ce6-96f5-956ba9d032a3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.758427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.759153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.759439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.759715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.760442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:46.761927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.827648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.sql.core [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 17:57:46.827648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 17:57:46.827648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [parameters: {'user_id': 'eed9c9c351ab4a239999cb922de331d4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 17:57:46.827648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80416) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() May 04 17:57:46.836741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:57:46.837726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application yield resource May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.rollback() May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.force_reraise() May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise self.value May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application session.commit() May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 17:57:46.838736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._prepare_impl() May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.flush() May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._flush(objects) May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application compat.raise_( May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application flush_context.execute() May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rec.execute(self) May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 17:57:46.839706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:57:46.840650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:57:46.841535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [parameters: {'user_id': 'eed9c9c351ab4a239999cb922de331d4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:46.842388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 17:57:46.844786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:46.846959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 489/977] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 17:57:46 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:46.855287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.964120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172c3ad-719e-4596-b1ef-39eee4f4d58d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.998378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.999700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.000189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.000663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.009255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.011003 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ff55d2d7-89a7-4f7d-93d3-8987cf21f220 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:47.026096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:47.027108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:57:47.028071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:47.030684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 489/978] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:57:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:47.036881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.138962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02480-c38c-4f54-84f6-23f26c4b90a6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.176845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.177517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.177798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.178073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.178880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:47.179218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.180830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf143-51ef-4a9b-affa-c011a8fa252d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.221714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 490/979] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 17:57:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:47.525224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c229d-6805-40d3-aec4-2f1973583d48 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.525726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c229d-6805-40d3-aec4-2f1973583d48 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.525726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c229d-6805-40d3-aec4-2f1973583d48 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.527324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 490/980] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:47.532366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9195-bc31-4833-b3f2-877637662e11 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.532665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9195-bc31-4833-b3f2-877637662e11 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.532937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9195-bc31-4833-b3f2-877637662e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.549710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8a8f9195-bc31-4833-b3f2-877637662e11 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:47.551265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8a8f9195-bc31-4833-b3f2-877637662e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:47.617046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 491/981] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:47.639711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c229d-6805-40d3-aec4-2f1973583d48 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.747248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c229d-6805-40d3-aec4-2f1973583d48 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.779907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f8dc2-b59b-4089-a1d3-81b1ecc02e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.780572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f8dc2-b59b-4089-a1d3-81b1ecc02e62 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.780850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f8dc2-b59b-4089-a1d3-81b1ecc02e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.781124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f8dc2-b59b-4089-a1d3-81b1ecc02e62 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.781848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f8dc2-b59b-4089-a1d3-81b1ecc02e62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.783242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f8dc2-b59b-4089-a1d3-81b1ecc02e62 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.871093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 491/982] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:47 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:48.027873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f57b-949b-410b-97d7-559ce2f3d2c7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.028272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f57b-949b-410b-97d7-559ce2f3d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.028476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f57b-949b-410b-97d7-559ce2f3d2c7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.030079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 492/983] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:48.036163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.036457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.036726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.054620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:48.055853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:48.128836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 492/984] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:48.151494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27f57b-949b-410b-97d7-559ce2f3d2c7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.255979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27f57b-949b-410b-97d7-559ce2f3d2c7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.290432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.291244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.291531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.291806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.292461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.293824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:48.305982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:48.307222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:48.308708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:48.309849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 493/985] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:48.313299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.411069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b52048-6161-4430-b8ff-8336bc6a645b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.445328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.445998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.446283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.446559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.447293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:48.447605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.448971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.455118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 493/986] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:48.459688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.557396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20600494-5ce8-438f-80e2-3418b41238e1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.590448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.591147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.591430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.591704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.592421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:48.592757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.594090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.604826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 494/987] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:48.606499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.710680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e07d-7eea-446a-be80-8637d253c18e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.745939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.746602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.746888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.747194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.747988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] RBAC: Adding query filter params (interface=admin, service_id=c777511dcdf6400fbc05abf64adf6ea9, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:48.748300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.749723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdff87-e551-476a-ad87-e611908c64b1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.760032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 494/988] 10.222.0.23 () {56 vars in 1249 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/endpoints?service_id=c777511dcdf6400fbc05abf64adf6ea9&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:48.761574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.857238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643df6fd-c4eb-45d6-be94-d72d5f6f9675 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.890619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb378c-6d4a-4680-b6c5-fce160451577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.891340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb378c-6d4a-4680-b6c5-fce160451577 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.891621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb378c-6d4a-4680-b6c5-fce160451577 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.891893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb378c-6d4a-4680-b6c5-fce160451577 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.892583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb378c-6d4a-4680-b6c5-fce160451577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.895146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb378c-6d4a-4680-b6c5-fce160451577 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.901929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 495/989] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:49.095835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ef0d-b3c8-4b0e-a92a-349e93298599 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.096122 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ef0d-b3c8-4b0e-a92a-349e93298599 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.096399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ef0d-b3c8-4b0e-a92a-349e93298599 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.098449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 495/990] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:49.103895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.104186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.104468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.122189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:49.123350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:49.191082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 496/991] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:49.210851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613ef0d-b3c8-4b0e-a92a-349e93298599 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.309627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613ef0d-b3c8-4b0e-a92a-349e93298599 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.342572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.343390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.343672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.343944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] PATH_INFO: `/v3/services/image` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.344584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.345944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:49.357752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:49.358738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:49.365036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 496/992] 10.222.0.23 () {56 vars in 1105 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:49.367342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.467076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57684e8-e8dc-458c-be9e-1542916f8fc8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.500141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.500800 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.501089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.501540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.502252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] RBAC: Adding query filter params (name=image) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:49.502563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.504332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47cacf-0dc9-4b97-a5f7-8cb35ad66a94 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.515103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 497/993] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:49.515260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.614379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd798-67fb-47c8-b756-1fb409497ccd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.648019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.648737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.649017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.649289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.650048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] RBAC: Adding query filter params (type=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:49.650350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.651735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cbff7-64a1-44e9-b8b9-ca51f2a84731 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.663093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 497/994] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:50.168525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41a9b6-7041-40a9-8df2-2ec33230f2b4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.169079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41a9b6-7041-40a9-8df2-2ec33230f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.169079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41a9b6-7041-40a9-8df2-2ec33230f2b4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.170565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 498/995] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:50.176117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.176498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.176783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.193261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:50.194432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:50.262354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 498/996] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:50.285322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41a9b6-7041-40a9-8df2-2ec33230f2b4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.383291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41a9b6-7041-40a9-8df2-2ec33230f2b4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:50.417267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:50.418061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.418341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.418664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.419292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:50.420654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:50.432894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:50.437319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:50.438190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 499/997] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:50.441310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.539498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887142-8d76-4a64-abb5-2ea11804dcf1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:50.573471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:50.574141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.574431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.574712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.575449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:50.575758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:50.577120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:50.587300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 499/998] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:50.588212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.687910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf748e-e058-4e93-91dd-d71e7a1b8754 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:50.721445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:50.722846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.723230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.723441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.724148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:50.724454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:50.725811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:50.735238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 500/999] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:50.736441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.840977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a82cb-3450-438c-af8b-1d9eb5d7742b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:50.876277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:50.876998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.877338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.877615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.878658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] RBAC: Adding query filter params (interface=public, service_id=62f478da91774d79974135dd6df029a8, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:50.879133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:50.880521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54a5a-cd7c-41a8-93c2-0d981d93e621 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:50.890075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 500/1000] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:50 2022] GET /identity/v3/endpoints?service_id=62f478da91774d79974135dd6df029a8&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:50.891283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.990445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c44b4-0d5c-4c33-bfc9-d2e3b550a5c5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.023223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcf74d-ee69-4026-8dda-09ff7dd62cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.023887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcf74d-ee69-4026-8dda-09ff7dd62cde None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.024167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcf74d-ee69-4026-8dda-09ff7dd62cde None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.024440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcf74d-ee69-4026-8dda-09ff7dd62cde None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.025114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcf74d-ee69-4026-8dda-09ff7dd62cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.026460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcf74d-ee69-4026-8dda-09ff7dd62cde None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.032816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 501/1001] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:50 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:51.261110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dbcb7-19c7-426b-a54d-5016bf5cf715 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.261397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dbcb7-19c7-426b-a54d-5016bf5cf715 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.261637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dbcb7-19c7-426b-a54d-5016bf5cf715 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.263083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 501/1002] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:51.268246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.269375 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.269375 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.287065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:51.288260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:51.356922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 502/1003] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:51.381116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dbcb7-19c7-426b-a54d-5016bf5cf715 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.501522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dbcb7-19c7-426b-a54d-5016bf5cf715 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.538192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.539126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.539417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.539697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.540434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.541945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:51.555700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:51.556946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:57:51.557944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:51.566066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 502/1004] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 17:57:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:51.566291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.673159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0c3b-1ed6-4c28-a9b5-dbf4f14f3bc8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.708148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.708822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.709108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.709387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.710098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:51.710405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.711836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.716926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 503/1005] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:51.722830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.826244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb894-b580-41d8-851e-22825fe3cf04 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.860113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.860779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.861062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.861340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.862073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:51.862413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.863908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f466-1d59-44b6-85c2-fedd9f828305 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.873949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 503/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 17:57:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:51.874836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.932476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8585-767a-4cc9-a8f8-1ed285f4d859 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.932772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8585-767a-4cc9-a8f8-1ed285f4d859 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.933111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8585-767a-4cc9-a8f8-1ed285f4d859 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.934471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 504/1007] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:51.939448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.939741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.940273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.957638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:51.958799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:51.975057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0746-3a79-458a-9829-0985e3e1707c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:52.012497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800d60-c3df-4573-a4f3-02aa840f3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:52.013163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800d60-c3df-4573-a4f3-02aa840f3d15 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:52.013469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800d60-c3df-4573-a4f3-02aa840f3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:52.013745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800d60-c3df-4573-a4f3-02aa840f3d15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:52.022949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800d60-c3df-4573-a4f3-02aa840f3d15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:52.022949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800d60-c3df-4573-a4f3-02aa840f3d15 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:52.025604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 505/1008] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:52.049358 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:52.113201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 504/1009] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:52.160145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ac92-0f24-4bea-8b2f-8c4dcf798afd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:52.206727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e9a2-f1f6-4ef8-aa69-bc001d94ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:52.207718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e9a2-f1f6-4ef8-aa69-bc001d94ceca None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:52.207988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e9a2-f1f6-4ef8-aa69-bc001d94ceca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:52.208156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e9a2-f1f6-4ef8-aa69-bc001d94ceca None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:52.208902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e9a2-f1f6-4ef8-aa69-bc001d94ceca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:52.210300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e9a2-f1f6-4ef8-aa69-bc001d94ceca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:52.310067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 506/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:52 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:53.332745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25959e6c-2d83-4767-8b63-41739c5fd975 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.333293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25959e6c-2d83-4767-8b63-41739c5fd975 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.333293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25959e6c-2d83-4767-8b63-41739c5fd975 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.334807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 505/1011] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:53.339971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.340401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.340498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.357443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:53.358623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:53.430545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 507/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:53 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:53.454090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25959e6c-2d83-4767-8b63-41739c5fd975 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:53.564191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25959e6c-2d83-4767-8b63-41739c5fd975 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:53.599251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:53.599978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.600278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.600541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.601198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:53.602568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:53.614628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:53.615949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:57:53.616814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:53.619442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 506/1013] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:53.622093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:53.723678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8db453-2a63-43d7-8efe-d07fad858a45 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:53.757611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:53.758286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.758568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.758847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.759642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:53.759954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:53.761323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:53.771703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 508/1014] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:53.773402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:53.873170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeedb0-2403-4b08-a733-bc00aae48f92 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:53.905294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:53.905961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.906244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.906522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.907258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:53.907566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:53.909435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d385bf-3b36-4b23-8240-3bd5ead7de5d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:53.919492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 507/1015] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 17:57:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:53.921275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.019387 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34913f-379a-4271-b1c8-fa5c9328dce9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.053570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1928ce7-464b-4f66-a897-fb13f9fd2fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.054237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1928ce7-464b-4f66-a897-fb13f9fd2fdf None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.054519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1928ce7-464b-4f66-a897-fb13f9fd2fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.054794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1928ce7-464b-4f66-a897-fb13f9fd2fdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.055644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1928ce7-464b-4f66-a897-fb13f9fd2fdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.056939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1928ce7-464b-4f66-a897-fb13f9fd2fdf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.171094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 509/1016] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:54.455510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e36a6-8b2d-4157-947f-09ede5d2cbb2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.456081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e36a6-8b2d-4157-947f-09ede5d2cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.456915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e36a6-8b2d-4157-947f-09ede5d2cbb2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.458477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 508/1017] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:54.463929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162008bd-bcc7-4c90-9058-4125d4db7433 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.464385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162008bd-bcc7-4c90-9058-4125d4db7433 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.464476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162008bd-bcc7-4c90-9058-4125d4db7433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.482397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-162008bd-bcc7-4c90-9058-4125d4db7433 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:54.483876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-162008bd-bcc7-4c90-9058-4125d4db7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:54.559039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 510/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:54.581918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e36a6-8b2d-4157-947f-09ede5d2cbb2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.587851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ebdd-07fe-49e9-84a9-29c9da7a5d5e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.588146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ebdd-07fe-49e9-84a9-29c9da7a5d5e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.588422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ebdd-07fe-49e9-84a9-29c9da7a5d5e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.589918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 511/1019] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:54.594655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.594940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.595251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.613909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:54.615109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:54.682343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 512/1020] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:54.688639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e36a6-8b2d-4157-947f-09ede5d2cbb2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.705628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.724949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.725827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.726020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.726296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.727490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.728963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.735394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 509/1021] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:54.736193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.810936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8af1-3e3e-449b-a9bb-48383f7e4aa6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.838434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827debc8-0f58-4aa2-b210-7f2897fb9fcd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.845378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.846164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.847032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.847382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] PATH_INFO: `/v3/services/image` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.848032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.849441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:54.860801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:54.861827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:54.863221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 513/1022] 10.222.0.23 () {56 vars in 1105 bytes} [Wed May 4 17:57:54 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:54.868168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.877740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.878730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.879065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.879330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.880071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.881484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.966656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b887-7aa5-46cc-9a12-8a3ba00fec42 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.967916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 510/1023] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:55.007538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.008230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.008516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.008838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.009777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] RBAC: Adding query filter params (name=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:55.010100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.011541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.017509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 514/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:55.024069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.134864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286df70-dd84-47d9-a5f6-55f1893799ad None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.170817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.171506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.171789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.172062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.172765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:55.173068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.174528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.180531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 511/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:55.186603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.286581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7526c3-0dce-4a6e-8028-1ea877277f9d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.320254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.320925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.321210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.321488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.322308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] RBAC: Adding query filter params (interface=public, service_id=1c20f00dd5844892ba2d126c0626c0c6, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:55.322620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.324214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0811d3c-b304-4bac-80a7-be9a6544d5ea None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.329275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 515/1026] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 17:57:55 2022] GET /identity/v3/endpoints?service_id=1c20f00dd5844892ba2d126c0626c0c6&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:55.335648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.445461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe46912-62f6-4d1e-9671-12514c1375b1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.499015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f51a48-4978-4a5e-8490-d72917cf0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.499815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51a48-4978-4a5e-8490-d72917cf0c27 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.499991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51a48-4978-4a5e-8490-d72917cf0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.500235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51a48-4978-4a5e-8490-d72917cf0c27 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.500906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f51a48-4978-4a5e-8490-d72917cf0c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.502301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f51a48-4978-4a5e-8490-d72917cf0c27 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.510008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 512/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 17:57:55 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:56.572243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a000595-b96e-4a8f-8fbe-4a5e6573b9a5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:56.572805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a000595-b96e-4a8f-8fbe-4a5e6573b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:56.572805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a000595-b96e-4a8f-8fbe-4a5e6573b9a5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:56.574138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 516/1028] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:56.579626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:56.580033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:56.580177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:56.597303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:56.598458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:56.671026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 513/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:56.695390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a000595-b96e-4a8f-8fbe-4a5e6573b9a5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:56.796221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a000595-b96e-4a8f-8fbe-4a5e6573b9a5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:56.830046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:56.831437 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:56.831720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:56.832101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:56.842630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:57:56.851827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:56.852796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:57:56.853882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:56.857949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 517/1030] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 17:57:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:56.859303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:56.956381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690d661-1d25-4f26-a44b-d86fa00e1211 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:56.989382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:56.990050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:56.990339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:56.990615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:56.991393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:56.991701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:56.993058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.006691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 514/1031] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:57:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:57.008501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.106902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f34ee-79d3-41b3-80e9-3ae037607ef4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.146458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.147287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.147591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.147860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.157862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.159494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-870bedeb-d998-48c4-a4fb-9125b113eab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:57.177402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:57.178355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:57.179299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:57.179299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:57.179299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:57.179299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:57.183262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 518/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:57.184526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.285251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c14c6-4c41-410b-bbb0-862794451cea None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.298476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b261-d13c-471a-8126-a59beff845af None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.298762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b261-d13c-471a-8126-a59beff845af None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.299078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b261-d13c-471a-8126-a59beff845af None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.300737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 519/1033] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:57:57.305801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.306089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.306366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.318972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.319658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.319938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.320328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.321044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:57.321346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.322695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.323779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:57.325114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:57.334932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 515/1034] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:57.340317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.395858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 520/1035] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:57:57.421094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.448491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa56d-e262-4ca7-b6f5-2644b44921f7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.484239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.485087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.485367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.485641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.493530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.494959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:57:57.509068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:57.510264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:57.511315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 516/1036] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:57.515799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.524030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12f1c8-89f1-4584-b694-16948aa9ab1d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.558428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.559250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.559534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.559810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.560967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.562397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.568935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 521/1037] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:57.570296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.614133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65cc53-bbc2-45fb-af16-52fe0bfde64f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.652946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.653533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.653883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.654198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.654920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:57.655259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.656698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.673444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cebbe-0ce5-4fb4-b06c-dff948af0295 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.675689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 517/1038] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:57.681097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:57.709777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3b48e-142a-4661-b4ff-c25d3cf1b087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.710454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b48e-142a-4661-b4ff-c25d3cf1b087 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.710740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b48e-142a-4661-b4ff-c25d3cf1b087 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.711042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b48e-142a-4661-b4ff-c25d3cf1b087 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.711755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3b48e-142a-4661-b4ff-c25d3cf1b087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.713203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3b48e-142a-4661-b4ff-c25d3cf1b087 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.780766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661f96-db42-454d-a859-fbc628e4537d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:57.792049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 522/1039] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:57:57 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:57.819067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:57.819749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.820082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.820319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.824503 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a7f13-2728-491c-a87b-7209ba56b30c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.824796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a7f13-2728-491c-a87b-7209ba56b30c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.825075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a7f13-2728-491c-a87b-7209ba56b30c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.826497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 523/1040] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:57:57.832773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:57.833149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:57.833352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:57.851149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:57.852395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:57.901067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:57.902572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:57.927785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 524/1041] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:57:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:57:57.951319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.007939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 518/1042] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:57:58.014339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.061471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a497f-50b3-4854-ad0b-6addc622ada6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.096694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.097907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.098396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.098889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.099790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.101356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.112781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4d70-5183-43df-b0ef-da9befddb1d5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:58.113795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:58.114976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:57:58.116030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:57:58.118576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 525/1043] 10.222.0.23 () {56 vars in 1105 bytes} [Wed May 4 17:57:57 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:58.124496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.147485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.148280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.148561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.148836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.159832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.161422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:57:58.180186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:58.181118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:58.182082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:57:58.182082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:57:58.182082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:57:58.182082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:58.182082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 519/1044] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:57:58.186837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.234573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8fbdb-829d-45d5-9d30-cc2e57c2dfe6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.270391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.271043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.271332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.271609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.272327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:58.272634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.274009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.279022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 526/1045] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:58.286014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.291576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544caa2-e71b-40d4-90fc-48bb7a364571 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.326517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.327228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.327518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.327795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.328517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:58.328825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.330195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.341883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 520/1046] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:58.348153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.389875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eedc0-a752-4e27-9c80-5b2a7e1f26b8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.426735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.427633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.427982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.428337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.429119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] RBAC: Adding query filter params (type=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:58.429496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.431027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.436308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 527/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:58.442472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.451253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0dc99-0ee0-4992-8777-ae8e124a28b3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.485995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.487591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.487887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.488279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.495199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.496664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:57:58.513120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:57:58.514112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:57:58.515076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 521/1048] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:57:58.520943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.551266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3acdbf-634c-4c86-b113-3b392763368b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.590117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeef2d-c7bb-4e44-aede-ccc496dc78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.590944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeef2d-c7bb-4e44-aede-ccc496dc78fc None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.591363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeef2d-c7bb-4e44-aede-ccc496dc78fc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.591744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeef2d-c7bb-4e44-aede-ccc496dc78fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.592584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeef2d-c7bb-4e44-aede-ccc496dc78fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.594118 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeef2d-c7bb-4e44-aede-ccc496dc78fc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.621225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974241b-2946-4338-b7db-cc1cee590607 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.654940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.655618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.655895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.656328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.657112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:58.657416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.658868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.670491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 522/1049] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:57:58.677413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:58.681683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 528/1050] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 17:57:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:58.787096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39712bd4-383b-4f6c-8a5d-7f1d19c23336 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:58.829943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:58.830818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:58.831244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:58.831681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:58.832665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] RBAC: Adding query filter params (role.id=be3eec78c99b4b8eb1281e711cfc6983, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=a8eeb8fcc242428cb31dc31e25e7865f) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:58.833097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:58.834628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b82c-28dc-446c-933d-f8d2ceff4743 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:58.847025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 523/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:57:58 2022] GET /identity/v3/role_assignments?user.id=a8eeb8fcc242428cb31dc31e25e7865f&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=be3eec78c99b4b8eb1281e711cfc6983 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:00.138055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391cc4a-1fec-4a2e-8d84-afc4494e429e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:00.138576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391cc4a-1fec-4a2e-8d84-afc4494e429e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:00.138689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391cc4a-1fec-4a2e-8d84-afc4494e429e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:00.140144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 529/1052] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:00.146037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:00.146460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:00.146656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:00.166378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:00.167900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:00.242159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 524/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:00.266005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391cc4a-1fec-4a2e-8d84-afc4494e429e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:00.368887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391cc4a-1fec-4a2e-8d84-afc4494e429e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:00.403666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:00.404385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:00.404670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:00.404946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:00.416129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:00.425067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:00.426198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:00.427615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:00.434421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 530/1054] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:00.434602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:00.534838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca6d22-6694-4a5f-9a25-be8eefae8689 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:00.569210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:00.569882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:00.570167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:00.570447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:00.571287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:00.571599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:00.572970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:00.586051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 525/1055] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:00.587690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:00.686832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c4b73-8fe9-4aaa-986c-f47eb918fb1e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:00.721126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b9b51-a6bc-4e4e-a363-49de2bfd22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:00.722012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9b51-a6bc-4e4e-a363-49de2bfd22e6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:00.722300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9b51-a6bc-4e4e-a363-49de2bfd22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:00.722579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9b51-a6bc-4e4e-a363-49de2bfd22e6 None admin] PATH_INFO: `/v3/users/388d8c46153d44ef88d514a31fa2da1f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:00.736143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b9b51-a6bc-4e4e-a363-49de2bfd22e6 None admin] RBAC: Authorizing `identity:get_user(user_id=388d8c46153d44ef88d514a31fa2da1f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:00.738370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b9b51-a6bc-4e4e-a363-49de2bfd22e6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:00.744962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 531/1056] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:00 2022] GET /identity/v3/users/388d8c46153d44ef88d514a31fa2da1f => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:00.745933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:00.852097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7efaa-4efb-414a-b5df-0b5daeabf8b6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:00.889642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:00.890285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:00.890571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:00.890857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:00.966483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:00.967888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.008152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81c81-fe9f-4fa5-a27c-61fc195e811e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.008447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81c81-fe9f-4fa5-a27c-61fc195e811e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.008726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81c81-fe9f-4fa5-a27c-61fc195e811e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.013786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 532/1057] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:58:01.015156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c129-f4f2-491f-afd0-142690eb1173 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.015445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c129-f4f2-491f-afd0-142690eb1173 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.015721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c129-f4f2-491f-afd0-142690eb1173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.034550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-79e4c129-f4f2-491f-afd0-142690eb1173 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:01.035804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-79e4c129-f4f2-491f-afd0-142690eb1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:01.082765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 526/1058] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:58:01.083878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.117727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 533/1059] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:01.119166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c090d-6e2f-4485-9c15-669bea6301db None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.119634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c090d-6e2f-4485-9c15-669bea6301db None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.119920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c090d-6e2f-4485-9c15-669bea6301db None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.121351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 534/1060] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:01.126743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.127608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.127890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.145050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:01.146232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:01.183510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d160b-c8c1-4626-a327-6d74eddc17d0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.211653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 535/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:01.212343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.219113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.219917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.220199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.220470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.221718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] RBAC: Authorizing `identity:get_project(project_id=56e4a6c7875f470dab4fe9ca61c61675)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.223164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.225149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 527/1062] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:01.230697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.313919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafa70b-8650-4944-ab72-eb73a79bae0a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.325171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b65b3-39f7-46db-97d4-63d2b1fc4438 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.347036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.347693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.347974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.348258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.358044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.358691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.358970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.359275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.360096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=56e4a6c7875f470dab4fe9ca61c61675, user.id=388d8c46153d44ef88d514a31fa2da1f) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:01.360508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.362536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.367864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 528/1063] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/role_assignments?user.id=388d8c46153d44ef88d514a31fa2da1f&scope.project.id=56e4a6c7875f470dab4fe9ca61c61675&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:01.368720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.427264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.428766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.484263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fb8ff-cbdb-4948-9efc-e1efdd87dcc5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.529683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.530509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.530797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.531133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.543224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 536/1064] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:01.544590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.547856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:01.556414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:01.557421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:01.558299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 529/1065] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:01.563931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.651450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945e6b4-07f1-4644-81bb-39732f21e40b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.674430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab33e0b-fbc3-45dd-8641-3425e182482b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.686169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.687065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.687436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.687716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.698640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.700130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.709223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.709895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.710184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.710467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.711325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:01.711638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.713005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:58:01.718596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:01.719550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:01.720454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:58:01.720454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:58:01.720454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:01.720454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:01.720454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 537/1066] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:01.724389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 530/1067] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:01.726246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.730026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:01.827228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632226-8deb-452d-b3bb-a10c3b3fbdf1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.842008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167424-7a41-4555-a136-9fa071c4d51b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:01.861775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.862440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.862726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.863013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.863746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:01.864053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.865415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.874670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:01.875594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:01.875775 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:01.876033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:01.877645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 538/1068] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:01.889545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:01.891032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:58:01.910009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:01.911312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:01.912271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:58:01.912271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:58:01.912271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:01.912271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:01.915388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 531/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:58:01.917302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:02.023262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02372-6736-4e49-b124-d230bc4b85b5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:02.060090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:02.060762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:02.061047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:02.061322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:02.062047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:02.062355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:02.063756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:02.079306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 539/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:02.084278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:02.194883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302b20-791a-4c34-8f53-ecc7ceb037a5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:02.229155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:02.229946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:02.230231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:02.230509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:02.238831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:02.240299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:58:02.255220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:02.256275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:02.257253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 532/1071] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:58:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:02.262194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:02.359490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d419cd-7846-4a56-a810-6e7441dca7f6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:02.394235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:02.394910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:02.395216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:02.395491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:02.396321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:02.396631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:02.398056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:02.416173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 540/1072] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:58:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:02.421697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:02.524553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe9c9-e5dc-41b4-a645-3ed16dc0f9ec None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:02.558032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:02.558816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:02.559139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:02.559417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:02.570216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:02.571715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:58:02.588684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:02.589728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:02.590701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:58:02.590701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:58:02.590701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:02.590701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:02.590701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 533/1073] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:02.596420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:02.691789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b60c9-7232-40cd-9ec0-0828ff1343ce None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:02.724038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:02.724696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:02.724982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:02.725261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:02.725978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:02.726286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:02.727816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:02.739184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 541/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:02.744884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:02.842281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4fb0-daa5-4cec-addc-0ac7eaca7d18 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:02.874783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:02.875610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:02.875896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:02.876172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:02.883664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:02.885100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:58:02.900037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:02.901028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:02.901952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 534/1075] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:02.907109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:03.004060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72459ab1-f027-433b-a1ec-56d374ee5dd4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:03.035975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:03.036625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:03.036903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:03.037175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:03.037952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:03.038260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:03.039719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd946e-49c2-45ef-bd74-2b76a84b97c1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:03.052709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 542/1076] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:03.058625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:03.158094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebec6-ca9a-4301-9f01-36977097d9e1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:03.191875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfeb89-1414-406e-a2ce-f544d8f7a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:03.192766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfeb89-1414-406e-a2ce-f544d8f7a04f None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:03.193051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfeb89-1414-406e-a2ce-f544d8f7a04f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:03.193329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfeb89-1414-406e-a2ce-f544d8f7a04f None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/a8eeb8fcc242428cb31dc31e25e7865f/roles/be3eec78c99b4b8eb1281e711cfc6983` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:03.195540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfeb89-1414-406e-a2ce-f544d8f7a04f None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=a8eeb8fcc242428cb31dc31e25e7865f, role_id=be3eec78c99b4b8eb1281e711cfc6983)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:03.196974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfeb89-1414-406e-a2ce-f544d8f7a04f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:03.277217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 535/1077] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:58:03 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/a8eeb8fcc242428cb31dc31e25e7865f/roles/be3eec78c99b4b8eb1281e711cfc6983 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:03.641735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69f16-d7b2-4999-8ba0-7198bc9485b9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:03.642399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69f16-d7b2-4999-8ba0-7198bc9485b9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:03.642399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69f16-d7b2-4999-8ba0-7198bc9485b9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:03.643716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 543/1078] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:03.650161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:03.650471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:03.650750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:03.668563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:03.669747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:03.739561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 536/1079] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:03.762696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69f16-d7b2-4999-8ba0-7198bc9485b9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:03.862208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69f16-d7b2-4999-8ba0-7198bc9485b9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:03.895355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:03.896078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:03.896357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:03.896630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:03.907134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:03.915502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:03.916618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:03.917819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 544/1080] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:03.922828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:04.016810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a556f1b-73eb-4154-a058-6ecb1c991f38 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:04.050417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:04.051112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:04.051401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:04.051675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:04.052417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:04.052723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:04.054082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:04.062109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 537/1081] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:04.069074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:04.166473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61597138-5a13-4e76-a067-ab9277904f95 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:04.203074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:04.203954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:04.204307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:04.204582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] PATH_INFO: `/v3/users/388d8c46153d44ef88d514a31fa2da1f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:04.206564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] RBAC: Authorizing `identity:get_user(user_id=388d8c46153d44ef88d514a31fa2da1f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:04.208023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:04.209666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 545/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:04 2022] GET /identity/v3/users/388d8c46153d44ef88d514a31fa2da1f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:04.215727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:04.312306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39df82-f6ab-4e06-b8e1-ee15eadabfff None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:04.345820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9e9fc-81a7-40cc-b4be-924ade916b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:04.346674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e9fc-81a7-40cc-b4be-924ade916b04 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:04.346955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e9fc-81a7-40cc-b4be-924ade916b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:04.347259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e9fc-81a7-40cc-b4be-924ade916b04 None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:04.348439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9e9fc-81a7-40cc-b4be-924ade916b04 None admin] RBAC: Authorizing `identity:get_project(project_id=56e4a6c7875f470dab4fe9ca61c61675)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:04.349861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9e9fc-81a7-40cc-b4be-924ade916b04 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:04.356263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 538/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:04 2022] GET /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:04.357410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:04.457414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95b35-ced4-40cf-9ad3-83ca286d8f44 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:04.490082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161f101-817d-48f2-bb3f-9fdae7937baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:04.490963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161f101-817d-48f2-bb3f-9fdae7937baa None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:04.491271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161f101-817d-48f2-bb3f-9fdae7937baa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:04.491546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161f101-817d-48f2-bb3f-9fdae7937baa None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675/users/388d8c46153d44ef88d514a31fa2da1f/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:04.493532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161f101-817d-48f2-bb3f-9fdae7937baa None admin] RBAC: Authorizing `identity:create_grant(project_id=56e4a6c7875f470dab4fe9ca61c61675, user_id=388d8c46153d44ef88d514a31fa2da1f, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:04.494967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161f101-817d-48f2-bb3f-9fdae7937baa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:04.565157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 546/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:58:04 2022] PUT /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675/users/388d8c46153d44ef88d514a31fa2da1f/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:05.527178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbed85-d518-4e81-a12a-2f205d1d9199 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:05.527678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbed85-d518-4e81-a12a-2f205d1d9199 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:05.527678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbed85-d518-4e81-a12a-2f205d1d9199 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:05.529012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 539/1085] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:05.535032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:05.535467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:05.535560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:05.552497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:05.553662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:05.619172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 547/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:05.643729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbed85-d518-4e81-a12a-2f205d1d9199 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:05.746363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbed85-d518-4e81-a12a-2f205d1d9199 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:05.778391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:05.779162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:05.779450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:05.779729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:05.790006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:05.798079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:05.799756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:05.801274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 540/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 17:58:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:05.805898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:05.900759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aec43-01b0-474b-afff-db8f804f503b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:05.934824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:05.935516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:05.935799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:05.936076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:05.936814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:05.937121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:05.938492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:05.946798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 548/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:58:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:05.952474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.051511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3dbbf-bd92-481e-b062-8be7207bad69 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.085805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.086602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.086887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.087194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.098436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.099918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:58:06.117005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:06.118117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:06.119330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:58:06.119330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:58:06.119330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:06.119330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:06.122868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 541/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:06.124145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.231161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398351f7-124c-480d-bc53-d2b3b6f31a1e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.264810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.265473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.265758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.266031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.266753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:06.268182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.269623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.281752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 549/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:06.288485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.386383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd31ebf-d783-47fa-b6cf-7682b73d69da None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.419807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.420598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.420879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.421152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.429042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.430484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:58:06.445646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:06.446943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:06.448231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 542/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:06.452692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.553806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad935a-c2a4-41ce-96c4-74c2c0708662 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.587611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.588281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.588566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.588844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.589706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:06.590017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.591482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f9f63-0f84-4005-8a59-cd96f824d76e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.611512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 550/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:06.617633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.719086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ebb9b-db84-47ea-9707-8c7f8f874e97 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.752462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.753259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.753538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.753809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.793371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705690-aa52-43e0-b830-88fc33a400c1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.793760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705690-aa52-43e0-b830-88fc33a400c1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.794162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705690-aa52-43e0-b830-88fc33a400c1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.795511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 551/1093] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:06.801345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.801634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.801917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.819156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:06.820412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:06.820551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.821848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.888089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 552/1094] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:58:06.911796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.919375 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 543/1095] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:06.925503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.008650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5a229-17e0-4a33-8cb0-64d4eceb92e6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.019324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795636a-a2ca-4cc8-a2c9-df626386d01f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.041721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.042510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.042790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.043090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.053293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.053465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:07.054072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.054356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.054631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:07.060895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:07.061915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:07.062955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 553/1096] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:58:07.064920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.066349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.068213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:58:07.083879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:07.085029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:07.086450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:58:07.086450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:58:07.086450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:58:07.086450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:07.086450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 544/1097] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:07.090810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.166937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cb84e-7fc0-4c2f-af00-e95ec9f82dc9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.188320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc5569-7aad-436c-857e-438a9861a6c9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.202015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.202691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.202973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.203274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.204022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:07.204362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.205766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.214861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 554/1098] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:07.221328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.226867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.227551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.227831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.228100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.228812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:07.229111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.230509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.246418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 545/1099] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:07.247688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.318740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc602f-d371-4fe5-827e-b37800eef3d2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.341256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf5c30-8737-49a8-980a-a95f7ec5ae76 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.354455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.355383 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.355669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.355972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] PATH_INFO: `/v3/users/388d8c46153d44ef88d514a31fa2da1f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.357185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] RBAC: Authorizing `identity:get_user(user_id=388d8c46153d44ef88d514a31fa2da1f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.358623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.360332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 555/1100] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/users/388d8c46153d44ef88d514a31fa2da1f => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:07.366386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.374950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.375758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.376037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.376921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.383758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.385214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:58:07.399883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:07.403890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:07.404826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 546/1101] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:58:07.406907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.504294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66290c36-5ecb-47b7-91ff-22c7c673f8ed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.538965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.539673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.539951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.540229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3409cbd-f0dc-44e1-8c51-91cc9c2b7935 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.540355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.573334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.573907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.574188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.574463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.575279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:07.575588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.577010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.588813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 547/1102] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:07.594814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.612345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.613845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.694618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd1a2-334c-4d69-a530-30206d553c69 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.714570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 556/1103] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:58:07.721099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.728537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.729185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.729467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.729742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.730566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] RBAC: Adding query filter params (role.id=be3eec78c99b4b8eb1281e711cfc6983, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=a8eeb8fcc242428cb31dc31e25e7865f) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:07.730875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.732336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.738121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 548/1104] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/role_assignments?user.id=a8eeb8fcc242428cb31dc31e25e7865f&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=be3eec78c99b4b8eb1281e711cfc6983 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:07.826364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e9d7-3c45-4170-8c2b-55adee1f8100 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.862271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe075b-023d-4e3d-b7dc-9a297ca0805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.863183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe075b-023d-4e3d-b7dc-9a297ca0805d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.863464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe075b-023d-4e3d-b7dc-9a297ca0805d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.863735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe075b-023d-4e3d-b7dc-9a297ca0805d None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.864937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe075b-023d-4e3d-b7dc-9a297ca0805d None admin] RBAC: Authorizing `identity:get_project(project_id=56e4a6c7875f470dab4fe9ca61c61675)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.866378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe075b-023d-4e3d-b7dc-9a297ca0805d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.868133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 557/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:07.874422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.976899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef48ce-da4a-4839-929c-b7a0260de303 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:08.009940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:08.010605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:08.010891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:08.011197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:08.012035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=56e4a6c7875f470dab4fe9ca61c61675, user.id=388d8c46153d44ef88d514a31fa2da1f) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:08.012345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:08.013762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1aaa0-210c-4500-bd57-8c9c74611464 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:08.020607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 549/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/role_assignments?user.id=388d8c46153d44ef88d514a31fa2da1f&scope.project.id=56e4a6c7875f470dab4fe9ca61c61675&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:10.285611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37bd6a-b591-47b3-8d25-f391e1aaf545 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.286154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37bd6a-b591-47b3-8d25-f391e1aaf545 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.286154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37bd6a-b591-47b3-8d25-f391e1aaf545 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.287726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 558/1107] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:10.293055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.293469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.293615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.310622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:10.311836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:10.375548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 550/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:58:10.400899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37bd6a-b591-47b3-8d25-f391e1aaf545 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:10.499945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37bd6a-b591-47b3-8d25-f391e1aaf545 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:10.534008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6f0c4-c698-4483-a76a-b912d17c2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:10.534795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6f0c4-c698-4483-a76a-b912d17c2c1d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.535109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6f0c4-c698-4483-a76a-b912d17c2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.535389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6f0c4-c698-4483-a76a-b912d17c2c1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.536561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6f0c4-c698-4483-a76a-b912d17c2c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:10.537983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6f0c4-c698-4483-a76a-b912d17c2c1d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:10.539733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 559/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:10.545554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:10.646548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804103b-d0c5-41ff-b0ef-22f6c054e68b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:10.678803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f253d-7c53-4044-9061-d95d1ba5f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:10.679484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f253d-7c53-4044-9061-d95d1ba5f6df None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.679763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f253d-7c53-4044-9061-d95d1ba5f6df None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.680035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f253d-7c53-4044-9061-d95d1ba5f6df None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.680739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f253d-7c53-4044-9061-d95d1ba5f6df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:10.682146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f253d-7c53-4044-9061-d95d1ba5f6df None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:10.786043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 551/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:58:10 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:13.085295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75680-a2fb-4088-895a-af47061a9787 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.085858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75680-a2fb-4088-895a-af47061a9787 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.085858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75680-a2fb-4088-895a-af47061a9787 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.087232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 560/1111] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:13.092453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.092875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.093011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.110030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:13.112055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:13.175170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 552/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:13.198441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75680-a2fb-4088-895a-af47061a9787 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.294367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75680-a2fb-4088-895a-af47061a9787 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.327753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.328588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.329620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.329900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] PATH_INFO: `/v3/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.331417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] RBAC: Authorizing `identity:get_role(role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.332780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.334142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 561/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/roles/db67dafa9e0248e284336b939235ff8e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:13.339946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.433579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b8e76-ae82-4a7e-a9b9-3ec2675d3a3c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.467176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.468041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.468325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.468603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] PATH_INFO: `/v3/users/5c8e6b69f37c40a895435abb94dbfe04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.482052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8e6b69f37c40a895435abb94dbfe04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.483587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.485360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 553/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/users/5c8e6b69f37c40a895435abb94dbfe04 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:13.491215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.590719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c3657-b7d3-4884-9ba5-2f5dec6df4ea None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.625879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.626804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.627117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.627395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.693783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.695268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.790892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 562/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:13.796760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.894795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba8f36-9482-4d37-aae8-edb800229a55 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.926734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66df9-ae01-4422-a26d-8fba7c6805fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.927645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66df9-ae01-4422-a26d-8fba7c6805fd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.927930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66df9-ae01-4422-a26d-8fba7c6805fd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.928211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66df9-ae01-4422-a26d-8fba7c6805fd None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.929383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66df9-ae01-4422-a26d-8fba7c6805fd None admin] RBAC: Authorizing `identity:get_project(project_id=56e4a6c7875f470dab4fe9ca61c61675)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.930815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66df9-ae01-4422-a26d-8fba7c6805fd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.932547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 554/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:13.939793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:14.035928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb84d-5a61-4652-8f5e-8889d27737b8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:14.069560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:14.070211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:14.070496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:14.070775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:14.071628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] RBAC: Adding query filter params (role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=56e4a6c7875f470dab4fe9ca61c61675, user.id=5c8e6b69f37c40a895435abb94dbfe04) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:14.072010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:14.073402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44613702-90f2-4d0a-9e01-204cdfe48df7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:14.079269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 563/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/role_assignments?user.id=5c8e6b69f37c40a895435abb94dbfe04&scope.project.id=56e4a6c7875f470dab4fe9ca61c61675&role.id=db67dafa9e0248e284336b939235ff8e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:16.294015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d54dc-3132-4d24-b5d7-6e1d7a5962e4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.294572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d54dc-3132-4d24-b5d7-6e1d7a5962e4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.294572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d54dc-3132-4d24-b5d7-6e1d7a5962e4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.295985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 555/1118] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:16.301324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.301755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.301868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.318457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:16.319681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:16.382238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 564/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:16.405670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d54dc-3132-4d24-b5d7-6e1d7a5962e4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.502949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d54dc-3132-4d24-b5d7-6e1d7a5962e4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.534598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.535481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.535767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.536044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] PATH_INFO: `/v3/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.537497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] RBAC: Authorizing `identity:get_role(role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.538849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.540259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 556/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:16 2022] GET /identity/v3/roles/db67dafa9e0248e284336b939235ff8e => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:16.546077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.642236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f4767-8a9c-47d3-9cc9-3812ac11d640 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.674367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.675241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.675521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.675791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] PATH_INFO: `/v3/users/5c8e6b69f37c40a895435abb94dbfe04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.676942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] RBAC: Authorizing `identity:get_user(user_id=5c8e6b69f37c40a895435abb94dbfe04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.678364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.680005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 565/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:16 2022] GET /identity/v3/users/5c8e6b69f37c40a895435abb94dbfe04 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:16.685873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.783181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a4a8-cf48-45b1-ab4c-d1c21c93bde4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.815896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcfb1f-294b-460c-900c-99ca24c8491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.816742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcfb1f-294b-460c-900c-99ca24c8491a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.817019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcfb1f-294b-460c-900c-99ca24c8491a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.817291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcfb1f-294b-460c-900c-99ca24c8491a None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.818439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcfb1f-294b-460c-900c-99ca24c8491a None admin] RBAC: Authorizing `identity:get_project(project_id=56e4a6c7875f470dab4fe9ca61c61675)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.819904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcfb1f-294b-460c-900c-99ca24c8491a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.821571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 557/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:16 2022] GET /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:16.827871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.924090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b5245-6370-4d82-950a-45ed1ab4983c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.956257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ead05-95c1-4523-b192-91e799701a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.957131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ead05-95c1-4523-b192-91e799701a08 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.957412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ead05-95c1-4523-b192-91e799701a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.957683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ead05-95c1-4523-b192-91e799701a08 None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675/users/5c8e6b69f37c40a895435abb94dbfe04/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.959874 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ead05-95c1-4523-b192-91e799701a08 None admin] RBAC: Authorizing `identity:create_grant(project_id=56e4a6c7875f470dab4fe9ca61c61675, user_id=5c8e6b69f37c40a895435abb94dbfe04, role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.961301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ead05-95c1-4523-b192-91e799701a08 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.038394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 566/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:58:16 2022] PUT /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675/users/5c8e6b69f37c40a895435abb94dbfe04/roles/db67dafa9e0248e284336b939235ff8e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:19.250039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055f58-bd58-4664-b811-68af36ddb668 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.250534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055f58-bd58-4664-b811-68af36ddb668 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.250645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055f58-bd58-4664-b811-68af36ddb668 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.252411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 558/1124] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:19.257688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.258097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.258236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.274472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:19.275654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.338545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 567/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:19.362238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055f58-bd58-4664-b811-68af36ddb668 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.459443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055f58-bd58-4664-b811-68af36ddb668 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.491535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.492373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.492656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.492929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] PATH_INFO: `/v3/roles/db67dafa9e0248e284336b939235ff8e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.494373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] RBAC: Authorizing `identity:get_role(role_id=db67dafa9e0248e284336b939235ff8e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.495744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.497111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 559/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/roles/db67dafa9e0248e284336b939235ff8e => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:19.502873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.596672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6c22-6133-4cdc-b886-bc14e38ca7f4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.628500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.629358 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.629637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.629908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] PATH_INFO: `/v3/users/5c8e6b69f37c40a895435abb94dbfe04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.631114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] RBAC: Authorizing `identity:get_user(user_id=5c8e6b69f37c40a895435abb94dbfe04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.632530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.634131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 568/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/users/5c8e6b69f37c40a895435abb94dbfe04 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:19.640021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.737189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683988e6-cc91-4bde-945c-b0a61a425b16 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.769023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.769655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.769938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.770213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.833585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.835042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.926702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 560/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:19.932582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:20.027529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ceabe-8dd1-4623-9168-1ad69b871a5e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:20.059073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa51b45-4377-4ee1-b642-197d5bd2f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:20.059915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51b45-4377-4ee1-b642-197d5bd2f893 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:20.060200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51b45-4377-4ee1-b642-197d5bd2f893 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:20.060475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51b45-4377-4ee1-b642-197d5bd2f893 None admin] PATH_INFO: `/v3/projects/56e4a6c7875f470dab4fe9ca61c61675` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:20.061630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa51b45-4377-4ee1-b642-197d5bd2f893 None admin] RBAC: Authorizing `identity:get_project(project_id=56e4a6c7875f470dab4fe9ca61c61675)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:20.063592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa51b45-4377-4ee1-b642-197d5bd2f893 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:20.065355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 569/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/projects/56e4a6c7875f470dab4fe9ca61c61675 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:20.071471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:20.165507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91712c1a-4673-45a5-a3cf-2ac2f682dcd7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:20.198765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:20.199443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:20.199729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:20.200002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:20.200837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] RBAC: Adding query filter params (role.id=db67dafa9e0248e284336b939235ff8e, scope.project.id=56e4a6c7875f470dab4fe9ca61c61675, user.id=5c8e6b69f37c40a895435abb94dbfe04) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:20.201148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:20.202584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95095f5-a86d-4792-a8d7-1a4500b4cba9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:20.209221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 561/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:20 2022] GET /identity/v3/role_assignments?user.id=5c8e6b69f37c40a895435abb94dbfe04&scope.project.id=56e4a6c7875f470dab4fe9ca61c61675&role.id=db67dafa9e0248e284336b939235ff8e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:22.479069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67137cf8-fdc1-4370-abba-d16b9b6c8173 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:22.479585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67137cf8-fdc1-4370-abba-d16b9b6c8173 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:22.479585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67137cf8-fdc1-4370-abba-d16b9b6c8173 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:22.480891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 570/1131] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:22.486168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:22.486592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:22.486718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:22.502781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:22.503977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:22.567877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 562/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:22.592138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67137cf8-fdc1-4370-abba-d16b9b6c8173 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:22.690851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67137cf8-fdc1-4370-abba-d16b9b6c8173 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:22.723290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f630e23-8d43-42eb-8e2a-1c5ac5ff53b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:22.724061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f630e23-8d43-42eb-8e2a-1c5ac5ff53b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:22.724341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f630e23-8d43-42eb-8e2a-1c5ac5ff53b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:22.724612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f630e23-8d43-42eb-8e2a-1c5ac5ff53b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:22.725757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f630e23-8d43-42eb-8e2a-1c5ac5ff53b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:22.727203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f630e23-8d43-42eb-8e2a-1c5ac5ff53b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:22.728788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 571/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:22.734864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:22.829211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7fb4-d5ad-43f6-81b0-bfc56e4e8397 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:22.860782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ae4b1-5244-4283-9d4d-a20324944b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:22.861425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ae4b1-5244-4283-9d4d-a20324944b24 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:22.861708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ae4b1-5244-4283-9d4d-a20324944b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:22.861985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ae4b1-5244-4283-9d4d-a20324944b24 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:22.862694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ae4b1-5244-4283-9d4d-a20324944b24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:22.864152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ae4b1-5244-4283-9d4d-a20324944b24 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:22.953680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 563/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:58:22 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:25.244513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2e387-d71f-4fcf-a844-edf60a936531 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:25.244997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2e387-d71f-4fcf-a844-edf60a936531 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:25.245084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2e387-d71f-4fcf-a844-edf60a936531 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:25.246417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 572/1135] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:25.251930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:25.252376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:25.252484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:25.268749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:25.269916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:25.333420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 564/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:58:25.357868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2e387-d71f-4fcf-a844-edf60a936531 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:25.454292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2e387-d71f-4fcf-a844-edf60a936531 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:25.486493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed94568-da69-4f5d-9cf0-9a75d69d8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:25.487228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94568-da69-4f5d-9cf0-9a75d69d8e96 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:25.487513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94568-da69-4f5d-9cf0-9a75d69d8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:25.487786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94568-da69-4f5d-9cf0-9a75d69d8e96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:25.488939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed94568-da69-4f5d-9cf0-9a75d69d8e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:25.490364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed94568-da69-4f5d-9cf0-9a75d69d8e96 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:25.491993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 573/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 17:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:25.497728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:25.592392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6334-936f-48e2-be02-199ff9217566 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:25.626480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912a111-e921-49d3-86e9-d482cd0058aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:25.627180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a111-e921-49d3-86e9-d482cd0058aa None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:25.627468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a111-e921-49d3-86e9-d482cd0058aa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:25.627748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a111-e921-49d3-86e9-d482cd0058aa None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:25.628455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a111-e921-49d3-86e9-d482cd0058aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:25.629892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a111-e921-49d3-86e9-d482cd0058aa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:25.723534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 565/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:58:25 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:28.012920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb748ce-9067-4171-a081-cf27432ea9b2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.013454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb748ce-9067-4171-a081-cf27432ea9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.013454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb748ce-9067-4171-a081-cf27432ea9b2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.015788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 574/1139] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:28.021196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.021646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.021790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.039129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:28.040315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:28.104522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 566/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:28.129201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb748ce-9067-4171-a081-cf27432ea9b2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.227600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb748ce-9067-4171-a081-cf27432ea9b2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.259749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.260483 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.260764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.261037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.271503 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:28.278894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:28.279986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:28.281197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 575/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:28.286168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.380688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca92aa-74a0-412e-8e67-8fb3a3eba6f4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.413112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.413766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.414048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.414324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.415082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:28.415386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.416796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.425083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 567/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:28.430866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.527792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda761e1-669d-4954-ae21-3b1e4b6decd4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.560017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.560861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.561138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.561419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] PATH_INFO: `/v3/users/c0b3a06b416a4d1f96be64382b4fef69` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.574222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] RBAC: Authorizing `identity:get_user(user_id=c0b3a06b416a4d1f96be64382b4fef69)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.575702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.577834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 576/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/users/c0b3a06b416a4d1f96be64382b4fef69 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:28.583932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.681742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af2efb-aaad-431f-998c-585cf98f1f38 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.715707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.716352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.716638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.716919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.783733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.785180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.878728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 568/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:28.884648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.978800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d194-665d-462b-a739-4e17bf732355 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:29.010859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63faf3-f11f-4583-afdb-1a8506474193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:29.011732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63faf3-f11f-4583-afdb-1a8506474193 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:29.012015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63faf3-f11f-4583-afdb-1a8506474193 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:29.012290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63faf3-f11f-4583-afdb-1a8506474193 None admin] PATH_INFO: `/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:29.013442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63faf3-f11f-4583-afdb-1a8506474193 None admin] RBAC: Authorizing `identity:get_project(project_id=a42250e2bdfc4d82bbb7ce7ff4e040db)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:29.014974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63faf3-f11f-4583-afdb-1a8506474193 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:29.016662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 577/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:29.022786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:29.119352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167065c6-687f-4ceb-95a0-99bc43c21702 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:29.150850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:29.151514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:29.151795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:29.152067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:29.152881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=a42250e2bdfc4d82bbb7ce7ff4e040db, user.id=c0b3a06b416a4d1f96be64382b4fef69) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:29.153195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:29.154599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618cc5d-2107-41b6-bf18-6f41423ee5fb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:29.160413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 569/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:29 2022] GET /identity/v3/role_assignments?user.id=c0b3a06b416a4d1f96be64382b4fef69&scope.project.id=a42250e2bdfc4d82bbb7ce7ff4e040db&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:31.390580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f840768-ffd3-49c0-a774-0ccca87ade1e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:31.391177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f840768-ffd3-49c0-a774-0ccca87ade1e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:31.391177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f840768-ffd3-49c0-a774-0ccca87ade1e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:31.392515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 578/1147] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:31.397846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:31.398239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:31.398415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:31.415734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:31.416947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:31.482290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 570/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:31.504677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f840768-ffd3-49c0-a774-0ccca87ade1e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:31.603111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f840768-ffd3-49c0-a774-0ccca87ade1e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:31.638520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:31.640187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:31.640187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:31.640477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:31.650210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:31.658428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:31.659683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:31.660788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 579/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:31.665750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:31.762306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280203-e49d-4a4f-afa3-b38144ee9c2d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:31.795591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:31.796472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:31.796754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:31.797029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:31.797769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:31.798072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:31.799458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:31.807271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 571/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:31.814109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:31.909424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509e33a-7040-45d4-80a0-de504984c268 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:31.941449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:31.942355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:31.942643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:31.942921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] PATH_INFO: `/v3/users/c0b3a06b416a4d1f96be64382b4fef69` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:31.944133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] RBAC: Authorizing `identity:get_user(user_id=c0b3a06b416a4d1f96be64382b4fef69)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:31.945561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:31.947211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 580/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:31 2022] GET /identity/v3/users/c0b3a06b416a4d1f96be64382b4fef69 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:31.954209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:32.050001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78825ee2-cb22-48cf-9aeb-1f317e77b611 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:32.083221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d7ba6-ce8c-487d-9cfa-904f5b0e5e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:32.084069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7ba6-ce8c-487d-9cfa-904f5b0e5e43 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:32.084347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7ba6-ce8c-487d-9cfa-904f5b0e5e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:32.084620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7ba6-ce8c-487d-9cfa-904f5b0e5e43 None admin] PATH_INFO: `/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:32.085776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d7ba6-ce8c-487d-9cfa-904f5b0e5e43 None admin] RBAC: Authorizing `identity:get_project(project_id=a42250e2bdfc4d82bbb7ce7ff4e040db)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:32.087226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d7ba6-ce8c-487d-9cfa-904f5b0e5e43 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:32.088913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 572/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:31 2022] GET /identity/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:32.094739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:32.191281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db25453-2ab5-45f9-849e-9297a2bf95bc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:32.226238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bb8a-5b20-48b2-af51-cda94fc867a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:32.227157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bb8a-5b20-48b2-af51-cda94fc867a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:32.227442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bb8a-5b20-48b2-af51-cda94fc867a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:32.227721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bb8a-5b20-48b2-af51-cda94fc867a9 None admin] PATH_INFO: `/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db/users/c0b3a06b416a4d1f96be64382b4fef69/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:32.229657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bb8a-5b20-48b2-af51-cda94fc867a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a42250e2bdfc4d82bbb7ce7ff4e040db, user_id=c0b3a06b416a4d1f96be64382b4fef69, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:32.231132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bb8a-5b20-48b2-af51-cda94fc867a9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:32.322965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 581/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:58:32 2022] PUT /identity/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db/users/c0b3a06b416a4d1f96be64382b4fef69/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:34.564272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604af2e-0612-4e11-a8cf-243c0dcf0453 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:34.564816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604af2e-0612-4e11-a8cf-243c0dcf0453 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:34.564816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604af2e-0612-4e11-a8cf-243c0dcf0453 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:34.566183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 573/1154] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:34.571373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790a17-0958-4767-83ac-0e192950755b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:34.571814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790a17-0958-4767-83ac-0e192950755b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:34.571920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790a17-0958-4767-83ac-0e192950755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:34.588864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-28790a17-0958-4767-83ac-0e192950755b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:34.590027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-28790a17-0958-4767-83ac-0e192950755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:34.655963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 582/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:34.679288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604af2e-0612-4e11-a8cf-243c0dcf0453 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:34.776440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604af2e-0612-4e11-a8cf-243c0dcf0453 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:34.808163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:34.808957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:34.809237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:34.809512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:34.820642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:34.828783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:34.830014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:34.831116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 574/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:34.836152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790a17-0958-4767-83ac-0e192950755b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:34.930460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790a17-0958-4767-83ac-0e192950755b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:34.962458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:34.963150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:34.963437 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:34.963714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:34.964452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:34.964760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:34.966125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:34.974549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 583/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:34.980328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:35.075011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920102e-ba76-4182-b6ee-c295a0accba6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:35.107497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:35.109016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:35.109302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:35.109580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] PATH_INFO: `/v3/users/c0b3a06b416a4d1f96be64382b4fef69` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:35.110757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] RBAC: Authorizing `identity:get_user(user_id=c0b3a06b416a4d1f96be64382b4fef69)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:35.112256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:35.113887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 575/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:34 2022] GET /identity/v3/users/c0b3a06b416a4d1f96be64382b4fef69 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:35.119722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:35.224446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942484e-adea-40eb-9d45-9ea7593d98c8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:35.256428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:35.257075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:35.257359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:35.257637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:35.324238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:35.325747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:35.424990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 584/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:35.430897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:35.535666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7eac3-9cfd-4839-9692-7d8729a1af5e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:35.568498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04762e7c-be05-48a3-b1dc-3f58c1231d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:35.569352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04762e7c-be05-48a3-b1dc-3f58c1231d33 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:35.569639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04762e7c-be05-48a3-b1dc-3f58c1231d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:35.569919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04762e7c-be05-48a3-b1dc-3f58c1231d33 None admin] PATH_INFO: `/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:35.571111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04762e7c-be05-48a3-b1dc-3f58c1231d33 None admin] RBAC: Authorizing `identity:get_project(project_id=a42250e2bdfc4d82bbb7ce7ff4e040db)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:35.572523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04762e7c-be05-48a3-b1dc-3f58c1231d33 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:35.574207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 576/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:35 2022] GET /identity/v3/projects/a42250e2bdfc4d82bbb7ce7ff4e040db => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:35.581379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:35.674696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c785f1-eaf6-4801-b2c8-4121ca43e63c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:35.707475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:35.708218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:35.708506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:35.708778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:35.709589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=a42250e2bdfc4d82bbb7ce7ff4e040db, user.id=c0b3a06b416a4d1f96be64382b4fef69) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:35.709898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:35.711335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c46eaf-5f3f-4c39-843f-4e95beaa4785 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:35.716878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 585/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:35 2022] GET /identity/v3/role_assignments?user.id=c0b3a06b416a4d1f96be64382b4fef69&scope.project.id=a42250e2bdfc4d82bbb7ce7ff4e040db&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:38.046720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957b88e-168c-4bc2-9d09-3e267ed967a0 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:38.047325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957b88e-168c-4bc2-9d09-3e267ed967a0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:38.047325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957b88e-168c-4bc2-9d09-3e267ed967a0 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:38.048651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 577/1162] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:58:38.054033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:38.054462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:38.054599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:38.073195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:38.074380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:38.139749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 586/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:38.162595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957b88e-168c-4bc2-9d09-3e267ed967a0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:38.262492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957b88e-168c-4bc2-9d09-3e267ed967a0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:38.297377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:38.297956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:38.298242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:38.298520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:38.363748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:38.365185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:38.460218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 578/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:38.466188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:38.560058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535b0b-6f1c-4030-8aa2-feba8a6ba2fd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:38.593070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:38.593862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:38.594142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:38.594415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:38.601067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:38.602511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7589496e-a93e-4697-84ba-cc6d0611d417 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:38.616468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:38.617708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:38.619047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 587/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 17:58:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:38.624281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:38.720901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060484de-331c-4c4a-ad05-771bf2ca254c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:38.754622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:38.755303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:38.755588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:38.755867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:38.756583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:38.756891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:38.758260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c821a0b-1c29-4fd3-bc5c-bfc2ead76ec3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:38.766131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 579/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 17:58:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:41.091843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202438-ebc5-4426-bbb2-0ab4802c311b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:41.092403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202438-ebc5-4426-bbb2-0ab4802c311b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:41.092403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202438-ebc5-4426-bbb2-0ab4802c311b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:41.093764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 588/1167] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:41.099346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689a9f-905c-493b-a2b2-5fc98f640290 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:41.099830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689a9f-905c-493b-a2b2-5fc98f640290 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:41.099942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689a9f-905c-493b-a2b2-5fc98f640290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:41.121231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-07689a9f-905c-493b-a2b2-5fc98f640290 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:41.122420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-07689a9f-905c-493b-a2b2-5fc98f640290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:41.192895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 580/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:41.220138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202438-ebc5-4426-bbb2-0ab4802c311b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:41.321569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202438-ebc5-4426-bbb2-0ab4802c311b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:41.353430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b70e0-cdd8-4b24-9c62-ee155ac4e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:41.354019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b70e0-cdd8-4b24-9c62-ee155ac4e570 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:41.354304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b70e0-cdd8-4b24-9c62-ee155ac4e570 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:41.354583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b70e0-cdd8-4b24-9c62-ee155ac4e570 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:41.355343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b70e0-cdd8-4b24-9c62-ee155ac4e570 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:41.356710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b70e0-cdd8-4b24-9c62-ee155ac4e570 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:41.428799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 589/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Wed May 4 17:58:41 2022] POST /identity/v3/domains => generated 267 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:43.700571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef4f86-80ff-4272-8f77-938874bc027f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.701132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef4f86-80ff-4272-8f77-938874bc027f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.701132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef4f86-80ff-4272-8f77-938874bc027f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.702492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 581/1170] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:43.708342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.708771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.708904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.727012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:43.728232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:43.792505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 590/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:43.817363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef4f86-80ff-4272-8f77-938874bc027f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:43.915329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef4f86-80ff-4272-8f77-938874bc027f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.948569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437b11f-3f90-4f77-9482-1b877f919692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.949426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437b11f-3f90-4f77-9482-1b877f919692 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.949707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437b11f-3f90-4f77-9482-1b877f919692 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.949980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437b11f-3f90-4f77-9482-1b877f919692 None admin] PATH_INFO: `/v3/domains/67c5396d6183472a93bff37d65a27028` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.961059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437b11f-3f90-4f77-9482-1b877f919692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=67c5396d6183472a93bff37d65a27028)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.962428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437b11f-3f90-4f77-9482-1b877f919692 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.964113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 582/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Wed May 4 17:58:43 2022] GET /identity/v3/domains/67c5396d6183472a93bff37d65a27028 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:43.969975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.064608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d686eca-6dd2-49b5-8fb9-0be2531c0f3c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.096298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8986a-5e5e-4331-97db-5ff355a210fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.096943 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8986a-5e5e-4331-97db-5ff355a210fd None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.097223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8986a-5e5e-4331-97db-5ff355a210fd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.097500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8986a-5e5e-4331-97db-5ff355a210fd None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.098193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8986a-5e5e-4331-97db-5ff355a210fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.099648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8986a-5e5e-4331-97db-5ff355a210fd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.190103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 591/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 17:58:43 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:46.448452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b8c9b-09f6-4ace-9a1b-17447fb74b1d None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:46.449001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b8c9b-09f6-4ace-9a1b-17447fb74b1d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:46.449001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b8c9b-09f6-4ace-9a1b-17447fb74b1d None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:46.450405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 583/1174] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:46.455591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:46.455987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:46.456086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:46.472470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:46.473640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:46.537179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 592/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:46.562471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b8c9b-09f6-4ace-9a1b-17447fb74b1d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:46.662428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b8c9b-09f6-4ace-9a1b-17447fb74b1d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:46.694720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d4dd9-81ec-46c8-9c81-5ccc44156c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:46.695597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d4dd9-81ec-46c8-9c81-5ccc44156c89 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:46.695875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d4dd9-81ec-46c8-9c81-5ccc44156c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:46.696147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d4dd9-81ec-46c8-9c81-5ccc44156c89 None admin] PATH_INFO: `/v3/domains/67c5396d6183472a93bff37d65a27028` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:46.697296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d4dd9-81ec-46c8-9c81-5ccc44156c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=67c5396d6183472a93bff37d65a27028)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:46.698731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d4dd9-81ec-46c8-9c81-5ccc44156c89 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:46.700404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 584/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Wed May 4 17:58:46 2022] GET /identity/v3/domains/67c5396d6183472a93bff37d65a27028 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:46.706525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:46.802458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42750c37-ad17-4dbc-95dd-2ba06020946e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:46.834685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9fc74-8ecb-42b9-a43f-60bb53305007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:46.835378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9fc74-8ecb-42b9-a43f-60bb53305007 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:46.835655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9fc74-8ecb-42b9-a43f-60bb53305007 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:46.835926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9fc74-8ecb-42b9-a43f-60bb53305007 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:46.836624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9fc74-8ecb-42b9-a43f-60bb53305007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:46.838044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9fc74-8ecb-42b9-a43f-60bb53305007 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:46.932507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 593/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 17:58:46 2022] POST /identity/v3/users => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:49.225675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acaa0-deb2-4a94-8ed0-d50453668517 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.226163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acaa0-deb2-4a94-8ed0-d50453668517 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.226266 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acaa0-deb2-4a94-8ed0-d50453668517 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.227610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 585/1178] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:49.232688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.233074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.233242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.249962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:49.251164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:49.314587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 594/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:58:49.338092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acaa0-deb2-4a94-8ed0-d50453668517 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:49.437132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acaa0-deb2-4a94-8ed0-d50453668517 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:49.469743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:49.470456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.470739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.471037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.480722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:49.488957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:49.490095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:49.491067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 586/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:49.496248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:49.592578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215aa89-c38c-40df-b46d-ded6660508e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:49.626576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:49.627281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.627570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.627848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.628595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:49.628902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:49.630268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:49.638584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 595/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:49.644376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:49.737891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ede6c-7b76-4840-9688-d86297e6b34b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:49.769503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:49.770357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.770637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.770910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] PATH_INFO: `/v3/users/561afd90c59b465aa1cd37381fc202d6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.785805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] RBAC: Authorizing `identity:get_user(user_id=561afd90c59b465aa1cd37381fc202d6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:49.787272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:49.788988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 587/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:49 2022] GET /identity/v3/users/561afd90c59b465aa1cd37381fc202d6 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:49.795603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:49.895356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98563323-02e8-499a-8d8f-d3981a40f6c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:49.929598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:49.930279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.930564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.930843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.996413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:49.998092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:50.097985 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 596/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:50.103925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:50.198618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e582b-285b-4370-9b16-14af22622282 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:50.236433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bc98b-a215-43b8-a776-782c251ebd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:50.237288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc98b-a215-43b8-a776-782c251ebd11 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:50.237572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc98b-a215-43b8-a776-782c251ebd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:50.237848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc98b-a215-43b8-a776-782c251ebd11 None admin] PATH_INFO: `/v3/projects/0ae76c0292db4254ba50356e7376d573` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:50.239036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bc98b-a215-43b8-a776-782c251ebd11 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae76c0292db4254ba50356e7376d573)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:50.240453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bc98b-a215-43b8-a776-782c251ebd11 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:50.242179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 588/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:50 2022] GET /identity/v3/projects/0ae76c0292db4254ba50356e7376d573 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:50.248439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:50.342725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18424c8-c9a8-4e84-91ab-d1d4f8a81b80 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:50.374695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:50.375363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:50.375643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:50.375914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:50.376725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=0ae76c0292db4254ba50356e7376d573, user.id=561afd90c59b465aa1cd37381fc202d6) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:50.377032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:50.378444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72376b02-7b5f-4121-9030-b6c4916cdd86 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:50.383659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 597/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:50 2022] GET /identity/v3/role_assignments?user.id=561afd90c59b465aa1cd37381fc202d6&scope.project.id=0ae76c0292db4254ba50356e7376d573&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:52.585924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339bdd5-edab-4c24-81fb-263b2d038164 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.586480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339bdd5-edab-4c24-81fb-263b2d038164 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.586480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339bdd5-edab-4c24-81fb-263b2d038164 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.587939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 589/1186] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:52.593713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.594135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.594263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.611101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:52.612263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:52.677541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 598/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:58:52.700651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339bdd5-edab-4c24-81fb-263b2d038164 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.799483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339bdd5-edab-4c24-81fb-263b2d038164 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.834228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.835034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.835325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.835603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.845779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:52.853360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:52.854483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 17:58:52.855924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 590/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:52.860716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.954781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c103314-8d54-4cd4-bd30-79299f57a6b4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.986018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.986664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.986941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.987247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.987974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:52.988274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.989622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.997790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 599/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:53.003894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:53.101805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafccf37-fe2a-41b9-b8ff-f2d7e4be3f9b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:53.135046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:53.135909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:53.136189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:53.136460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] PATH_INFO: `/v3/users/561afd90c59b465aa1cd37381fc202d6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:53.138749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] RBAC: Authorizing `identity:get_user(user_id=561afd90c59b465aa1cd37381fc202d6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:53.140200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:53.141830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 591/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:53 2022] GET /identity/v3/users/561afd90c59b465aa1cd37381fc202d6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:53.148068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:53.244674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556042a1-11d4-4065-a535-3daf786a5b72 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:53.276595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c615e0-6e09-4bf6-babe-54968d89a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:53.277463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c615e0-6e09-4bf6-babe-54968d89a364 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:53.277751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c615e0-6e09-4bf6-babe-54968d89a364 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:53.278045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c615e0-6e09-4bf6-babe-54968d89a364 None admin] PATH_INFO: `/v3/projects/0ae76c0292db4254ba50356e7376d573` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:53.279369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c615e0-6e09-4bf6-babe-54968d89a364 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae76c0292db4254ba50356e7376d573)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:53.280817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c615e0-6e09-4bf6-babe-54968d89a364 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:53.282501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 600/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:53 2022] GET /identity/v3/projects/0ae76c0292db4254ba50356e7376d573 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:53.288543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:53.385563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb70735-727f-4bb7-9c58-d60d73ab06f4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:53.417677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309d3a0-c71e-44da-bd37-699633946c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:53.419378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309d3a0-c71e-44da-bd37-699633946c4f None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:53.419670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309d3a0-c71e-44da-bd37-699633946c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:53.419950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309d3a0-c71e-44da-bd37-699633946c4f None admin] PATH_INFO: `/v3/projects/0ae76c0292db4254ba50356e7376d573/users/561afd90c59b465aa1cd37381fc202d6/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:53.421901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309d3a0-c71e-44da-bd37-699633946c4f None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae76c0292db4254ba50356e7376d573, user_id=561afd90c59b465aa1cd37381fc202d6, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:53.423344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309d3a0-c71e-44da-bd37-699633946c4f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:53.532354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 592/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 17:58:53 2022] PUT /identity/v3/projects/0ae76c0292db4254ba50356e7376d573/users/561afd90c59b465aa1cd37381fc202d6/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:55.775695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198a65f-ed05-458b-93e2-41ef27391a60 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:55.776255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198a65f-ed05-458b-93e2-41ef27391a60 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:55.776255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198a65f-ed05-458b-93e2-41ef27391a60 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:55.777694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 601/1193] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 17:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:58:55.783541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:55.783944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:55.784106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:55.800613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:55.801798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:55.866472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 593/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 17:58:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:58:55.889740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198a65f-ed05-458b-93e2-41ef27391a60 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:55.987649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198a65f-ed05-458b-93e2-41ef27391a60 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.019086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.019879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.020163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.020440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.031391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:58:56.038931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:58:56.040017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 17:58:56.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 602/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 17:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:58:56.047007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:56.140146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e92bd-8003-47f1-b263-cbdff6d416b5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.181259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.181931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.182212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.182484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.183261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:56.183599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:56.185318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:56.193837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 594/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 17:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:56.200365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:56.293769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730455-ba25-40bf-8766-ecf0232de869 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.326028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.326886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.327194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.327469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] PATH_INFO: `/v3/users/561afd90c59b465aa1cd37381fc202d6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.328625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] RBAC: Authorizing `identity:get_user(user_id=561afd90c59b465aa1cd37381fc202d6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:56.330082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:56.331726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 603/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 17:58:56 2022] GET /identity/v3/users/561afd90c59b465aa1cd37381fc202d6 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:56.337910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:56.435416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a21db-f00c-43e8-8eb8-9a2a131a45e7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.468809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.469456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.469741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.470018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.535534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:56.536984 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:56.630831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 595/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 17:58:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:58:56.637462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:56.734509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9254-1740-463f-8dd3-4f1a2b155b44 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.769868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43bfc-c77c-4ae2-a84e-b4ef0b255908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.770718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43bfc-c77c-4ae2-a84e-b4ef0b255908 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.771022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43bfc-c77c-4ae2-a84e-b4ef0b255908 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.771306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43bfc-c77c-4ae2-a84e-b4ef0b255908 None admin] PATH_INFO: `/v3/projects/0ae76c0292db4254ba50356e7376d573` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.772476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f43bfc-c77c-4ae2-a84e-b4ef0b255908 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae76c0292db4254ba50356e7376d573)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:56.773903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f43bfc-c77c-4ae2-a84e-b4ef0b255908 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:56.775751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 604/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 17:58:56 2022] GET /identity/v3/projects/0ae76c0292db4254ba50356e7376d573 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:56.781977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:56.876733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f33b9-d022-49db-8f38-780bd995d469 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.909361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.909932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.910209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.910480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.911330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=0ae76c0292db4254ba50356e7376d573, user.id=561afd90c59b465aa1cd37381fc202d6) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:56.911640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:56.913044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1dc4e-65fb-4046-b790-aa63c1bd6aa5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:56.919799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 596/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 17:58:56 2022] GET /identity/v3/role_assignments?user.id=561afd90c59b465aa1cd37381fc202d6&scope.project.id=0ae76c0292db4254ba50356e7376d573&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:15.983436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc332-1473-4d1b-9ce1-6360e6c37873 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:15.984023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc332-1473-4d1b-9ce1-6360e6c37873 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:15.984023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc332-1473-4d1b-9ce1-6360e6c37873 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:15.985385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 605/1201] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:15.990494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:15.990943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:15.991149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:16.007424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:16.008598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:16.073805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 597/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:00:16.098743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc332-1473-4d1b-9ce1-6360e6c37873 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:16.200942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc332-1473-4d1b-9ce1-6360e6c37873 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:16.237001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:16.237764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:16.238049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:16.238348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:16.249010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:16.253272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:16.268682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:16.269806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:16.271282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:16.271282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:16.271282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:16.271282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:16.271282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 606/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:16.276500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:16.373108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56831d65-e0f7-4285-b0b3-c2a4f7f21b1c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:16.407815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:16.408470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:16.408753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:16.409030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:16.409746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:16.410052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:16.411484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b6e04-94d7-4229-849e-b685bba7cb04 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:16.422380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 598/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:16.428515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:16.529897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374df8-0c91-4bbc-b6fd-dbd0c9490444 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:16.562718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f462d9-75fc-45ed-be40-055220b5fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:16.563458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f462d9-75fc-45ed-be40-055220b5fa3e None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:16.563734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f462d9-75fc-45ed-be40-055220b5fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:16.564005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f462d9-75fc-45ed-be40-055220b5fa3e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:16.564702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f462d9-75fc-45ed-be40-055220b5fa3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:16.566141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f462d9-75fc-45ed-be40-055220b5fa3e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:16.643945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 607/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 18:00:16 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:00:18.987894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316b040-4237-4c9b-b3ae-8e30caa83460 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:18.988463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316b040-4237-4c9b-b3ae-8e30caa83460 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:18.988463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316b040-4237-4c9b-b3ae-8e30caa83460 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:18.989815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 599/1206] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:18.995722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:18.996129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:18.996289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.014056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:19.015303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:19.083655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 608/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:19.108235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316b040-4237-4c9b-b3ae-8e30caa83460 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:19.208402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316b040-4237-4c9b-b3ae-8e30caa83460 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:19.243083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:19.243812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:19.244305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:19.244657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.254859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:00:19.263497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:19.264695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:19.265757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 600/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:00:19.273010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:19.370459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b30ba0-254e-44b1-921c-7236b53afccd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:19.403946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:19.404602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:19.404882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:19.405161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.405905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:19.406261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:19.407644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:19.415423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 609/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:19.421192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:19.518389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b942-7a03-4ec4-ae9f-d2322188cd92 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:19.550639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:19.551692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:19.551970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:19.552351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.562858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:19.564350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:19.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:19.583913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:19.584955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:19.584955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:19.584955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:19.584955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:19.584955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 601/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:19.591269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:19.691175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c76a-24b5-4681-8d8e-41e28e1ae33f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:19.724786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:19.725443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:19.725721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:19.726143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.726860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:19.727191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:19.728609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:19.740048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 610/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:19.746765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:19.845797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9b83-b0b3-45a9-9816-0d3c0c676ebc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:19.879544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:19.880342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:19.880635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:19.880960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.888355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:19.889786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:00:19.904361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:19.905436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:19.906638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 602/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:19.911634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:20.011924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bad29-015e-43fb-a155-de7107dc3064 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:20.045936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:20.046609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:20.046913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:20.047205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:20.048035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:20.048350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:20.049787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:20.066589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 611/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:20.073041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:20.174532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232b00-1f48-45d0-be0f-a59d93ee557f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:20.208135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:20.212517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:20.212517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:20.212517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:20.273419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:20.274878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:20.371130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 603/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 18:00:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:00:20.377162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:20.475120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a92e8-562c-45ef-83a7-e1b104a23d2d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:20.508084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:20.508897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:20.509207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:20.510002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:20.519872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:20.521314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:20.538655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:20.539828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:20.540940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:20.540940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:20.540940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:20.540940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:20.540940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 612/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:20.546013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:20.645672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3d514-c5c0-4d43-b41b-c3d0ed59c441 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:20.678685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:20.679365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:20.679653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:20.679930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:20.680648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:20.680985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:20.683173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:20.694495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 604/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:20.701260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:20.800472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44db00-f031-454c-a8b6-43ad28ab8890 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:20.834798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:20.835621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:20.835902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:20.836344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:20.843766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:20.845199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:00:20.858914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:20.860001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:20.861165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 613/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 18:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:20.866190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:20.965096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6a88-5df5-4e22-a745-a818ccc3a7b6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:20.997995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:20.998659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:20.998950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:20.999272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:21.000080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:21.000387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:21.001823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59421ba-0633-477c-bcdc-5732dc157810 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:21.014927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 605/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 18:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:21.021198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:21.120002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63ecc-e4fc-48b9-9be2-3df3573bbcd8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:21.153285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:21.153940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:21.154223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:21.154497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:21.155354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=dd702379f5004159abc50fab8d398a6d) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:21.155656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:21.160114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece6865-17a3-48ae-bcd5-9937ec8d86e3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:21.162428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 614/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 18:00:21 2022] GET /identity/v3/role_assignments?user.id=dd702379f5004159abc50fab8d398a6d&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:23.432039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c498f-4473-4ef0-b861-790a00421211 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:23.432610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c498f-4473-4ef0-b861-790a00421211 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:23.432610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c498f-4473-4ef0-b861-790a00421211 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:23.433986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 606/1220] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:23.439474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:23.439955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:23.440048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:23.457858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:23.458962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:23.527014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 615/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:23.550873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c498f-4473-4ef0-b861-790a00421211 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:23.651700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c498f-4473-4ef0-b861-790a00421211 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:23.684132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:23.684919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:23.686562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:23.686562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:23.695651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:00:23.703869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:23.704879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:23.705785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 607/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 18:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:23.711448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:23.808079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86096515-70e2-480d-8287-3cc09ca8e023 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:23.841832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:23.842492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:23.842775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:23.843078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:23.843814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:23.844120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:23.845488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:23.853796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 616/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 18:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:23.860095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:23.959886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9b2c-b580-4a8c-a9f8-2122edbc3a5f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:23.993047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:23.994181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:23.994474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:23.994753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.005539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.007036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:24.025122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:24.026359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:24.027475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:24.027475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:24.027475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:24.027475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:24.027475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 608/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:24.032517 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:24.130721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5259-d992-4c3d-9699-c3513fa8711b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:24.163695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:24.164356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:24.164642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:24.164920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.165966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:24.166270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.167679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.179480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 617/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:24.186485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:24.283973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5de68-7efb-4e4b-a733-585334ecf9b9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:24.317315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:24.318114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:24.318396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:24.318672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.326718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.328305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:00:24.342382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:24.343500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:24.344780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 609/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:24.349903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:24.448670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d179c-52e3-4260-98e7-71d0d4e0cc44 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:24.482321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:24.483015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:24.483300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:24.483579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.484411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:24.484724 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.486195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.504140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 618/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 18:00:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:24.510039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:24.612191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328ab19-46b7-4801-90e6-31bd2febc824 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:24.645798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:24.646593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:24.646885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:24.647227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.657673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.659161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:24.676999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:24.678089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:24.679311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:24.679311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:24.679311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:24.679311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:24.679311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 610/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:24.684747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:24.782826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4287da0-3447-4088-aac6-aaebacc2989f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:24.816954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:24.817611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:24.817896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:24.818172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.818886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:24.819221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.820585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.832110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 619/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:24.838687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:24.937459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130148b4-06bf-45fb-8c6d-95f006a8062e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:24.970157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:24.970943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:24.971303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:24.971561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:24.978925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:24.980391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:00:24.994867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:24.996008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:24.996948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 611/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 18:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:00:25.001961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:25.101646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69897cd-d090-4ab2-ace0-5705731f20ac None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:25.134959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:25.135659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:25.135948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:25.136225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:25.137013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:25.137323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:25.138751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a2921-9a80-4a2e-b541-91c65ebf00ba None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:25.151560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 620/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 18:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:00:25.157730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:25.254078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fb36d-3a26-4fcc-9701-b595896f1653 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:25.287835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f8716-8ed7-44d9-824d-785a5921b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:25.288716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8716-8ed7-44d9-824d-785a5921b993 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:25.289001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8716-8ed7-44d9-824d-785a5921b993 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:25.289280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8716-8ed7-44d9-824d-785a5921b993 None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/dd702379f5004159abc50fab8d398a6d/roles/d0d3d98bd16640c484c2c90db9649b3c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:25.303492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f8716-8ed7-44d9-824d-785a5921b993 None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=dd702379f5004159abc50fab8d398a6d, role_id=d0d3d98bd16640c484c2c90db9649b3c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:25.304924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f8716-8ed7-44d9-824d-785a5921b993 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:25.395488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 612/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 18:00:25 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/dd702379f5004159abc50fab8d398a6d/roles/d0d3d98bd16640c484c2c90db9649b3c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:00:27.635171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811d57-f386-42ff-b407-d717fdc9fe22 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:27.635700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811d57-f386-42ff-b407-d717fdc9fe22 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:27.635816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811d57-f386-42ff-b407-d717fdc9fe22 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:27.637097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 621/1233] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:27.642290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:27.642705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:27.642844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:27.660633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:27.661814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:27.727045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 613/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:27.752110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811d57-f386-42ff-b407-d717fdc9fe22 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:27.853735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811d57-f386-42ff-b407-d717fdc9fe22 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:27.887062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:27.887795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:27.888076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:27.888355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:27.898139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:00:27.906298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:27.908110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:27.909777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 622/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 18:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:00:27.913653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:28.010697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6886b-9f17-4c8f-9ad1-e4437865d5e0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:28.043594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:28.044249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:28.044526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:28.044793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:28.045520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:28.045820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:28.047213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:28.055010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 614/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 18:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:00:28.060842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:28.158146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7df0b-f24d-4079-b51b-46452d55e2ca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:28.190969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:28.191779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:28.192700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:28.192700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:28.203569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:28.205020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:28.222111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:28.223282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:28.224567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:28.224567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:28.224567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:28.224567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:28.224567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 623/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:28.229659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:28.326972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a598db3-7d3f-4878-bdd6-d6e7a59a1ce5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:28.359962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:28.360614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:28.360898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:28.361177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:28.361887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:28.362195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:28.363591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:28.375869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 615/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:28.381529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:28.480629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940579-fe6b-420c-94a1-4518bce13510 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:28.513650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:28.514451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:28.514737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:28.515034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:28.522285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:28.523763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:00:28.537662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:28.538693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:28.540174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 624/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:28.545198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:28.646645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad894d70-171d-47c6-81cc-370e7f5a782a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:28.681650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:28.682306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:28.682592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:28.682869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:28.683734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:28.684045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:28.685463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:28.702376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 616/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 18:00:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:28.708159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:28.805963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b81d56-fbf8-490f-a7ff-1c5cb6fabd20 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:28.838131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:28.838774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:28.839085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:28.839363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:28.905465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:28.906917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:29.001529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 625/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 18:00:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:00:29.007399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:29.106813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78663e21-9937-45c8-ba29-5b9a12c964bc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:29.140937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:29.141697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:29.141982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:29.142262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:29.153614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:29.155086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:29.173213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:29.174315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:29.175719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:29.175719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:29.175719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:29.175719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:29.175719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 617/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:29.180487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:29.279501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896655de-da14-4143-a9a0-6f045aae1517 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:29.312467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:29.313186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:29.313472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:29.313749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:29.314467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:29.314776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:29.316185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:29.327748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 626/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:29.333460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:29.433852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19c50-c9b9-4c27-bbe1-16bd90c9a894 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:29.468471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:29.469070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:29.469353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:29.469627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:29.476301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:29.478323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:00:29.491834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:29.493481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:29.494635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 618/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 18:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:29.499821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:29.597009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ecd46-81d7-4fdb-9717-3adcdfdaf187 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:29.630914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:29.631689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:29.631977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:29.632257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:29.633037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:29.634373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:29.635995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50868537-5e01-4c42-b888-f47f362679a1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:29.647893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 627/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 18:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:29.654384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:29.752855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149481c-3b70-4ede-a14f-eb4be51b9bd8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:29.784967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:29.785669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:29.785951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:29.786224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:29.787064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] RBAC: Adding query filter params (role.id=d0d3d98bd16640c484c2c90db9649b3c, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=dd702379f5004159abc50fab8d398a6d) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:29.787374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:29.788780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c110-857c-4401-ba97-5e2c07e73d00 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:29.795178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 619/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 18:00:29 2022] GET /identity/v3/role_assignments?user.id=dd702379f5004159abc50fab8d398a6d&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=d0d3d98bd16640c484c2c90db9649b3c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:32.172767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5ba8-14b5-4955-b0a5-f7bcf676d455 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:32.173321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5ba8-14b5-4955-b0a5-f7bcf676d455 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:32.173321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5ba8-14b5-4955-b0a5-f7bcf676d455 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:32.174747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 628/1247] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:32.180144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:32.180563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:32.180712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:32.198179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:32.199418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:32.264610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 620/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:32.290338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5ba8-14b5-4955-b0a5-f7bcf676d455 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:32.392497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5ba8-14b5-4955-b0a5-f7bcf676d455 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:32.425462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:32.426181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:32.426469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:32.426746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:32.438099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:00:32.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:32.447767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:32.448641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 629/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 18:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:32.454515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:32.552384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06975-abfd-4ba3-bda5-a383941f4459 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:32.586620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:32.587385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:32.587672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:32.587948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:32.588691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:32.588995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:32.590364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:32.599461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 621/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 18:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:32.605378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:32.705898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236e96b-c936-447f-9a87-850b0ded2f46 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:32.739116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:32.739927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:32.740215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:32.740495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:32.751694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:32.753133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:32.770324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:32.771467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:32.772441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:32.772441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:32.772441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:32.772441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:32.772441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 630/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:32.777943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:32.877500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147b2ae-2c49-4fb7-b984-d7413824e9ca None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:32.910749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:32.911438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:32.911724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:32.912002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:32.912719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:32.913022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:32.914382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:32.926935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 622/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:00:32.932855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:33.031439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98f65-06cd-47b8-a652-8af3011b5253 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:33.064447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:33.065249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:33.065527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:33.065803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:33.074191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:33.075690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:00:33.090666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:33.091830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:33.093359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 631/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:33.097910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:33.199635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db248c-c508-4234-91b2-85f3b2c502a5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:33.232585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:33.233243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:33.233523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:33.233795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:33.234627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:33.234932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:33.236361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:33.253762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 623/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 18:00:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:33.260475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:33.360314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e61b29-9539-4969-a9fa-3b534043a021 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:33.394924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:33.395605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:33.395891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:33.396167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:33.461628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:33.463095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:33.559510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 632/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 18:00:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:00:33.565378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:33.664225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba2e2-25d6-4b2a-8f3b-988aefbc7739 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:33.698313 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:33.699135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:33.699416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:33.699688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:33.709516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:33.711012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:33.728741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:33.736644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:33.737771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:33.737771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:33.737771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:33.737771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:33.737771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 624/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:33.738107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:33.835504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a84ea-7786-421d-b225-8f8d27fcf62f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:33.870770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:33.871462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:33.871746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:33.872025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:33.872741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:33.873052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:33.874413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:33.886337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 633/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:33.892051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:33.990786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac5b7-c31e-4494-a757-238a42fd2458 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:34.023918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:34.025517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:34.025805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:34.026089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:34.032752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:34.034183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:00:34.048058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:34.049229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:34.050682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 625/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 18:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:34.056022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:34.153540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5440-daa9-4038-a38b-11f3a318516b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:34.186636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:34.187313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:34.187596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:34.187871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:34.188639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:34.188944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:34.190360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9245bd-0a52-4098-9c0f-441c07ff26e6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:34.202913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 634/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 18:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:34.208986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:34.310928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90721d-1a22-4248-bfee-ff4be65b34e8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:34.344386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:34.349390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:34.349390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:34.349390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:34.349390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=dd702379f5004159abc50fab8d398a6d) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:34.349390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:34.349390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553b2a-6bbe-4173-a14e-65b27f686928 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:34.354750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 626/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 18:00:34 2022] GET /identity/v3/role_assignments?user.id=dd702379f5004159abc50fab8d398a6d&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:36.580031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071d61a-1221-402e-9aa8-c413b59adb22 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:36.580601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071d61a-1221-402e-9aa8-c413b59adb22 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:36.580601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071d61a-1221-402e-9aa8-c413b59adb22 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:36.581972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 635/1261] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:36.587193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:36.587591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:36.587754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:36.604841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:36.606025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:36.672220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 627/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:36.695844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071d61a-1221-402e-9aa8-c413b59adb22 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:36.794003 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071d61a-1221-402e-9aa8-c413b59adb22 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:36.826521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:36.827326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:36.827604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:36.827880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:36.838460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:00:36.845928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:36.847135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:36.848246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 636/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 18:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:36.854033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:36.951184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733ae9f-74d0-4b6b-8888-5e09ad53f403 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:36.984556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:36.985306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:36.985591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:36.985868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:36.986608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:36.986912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:36.988325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:36.996487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 628/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 18:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:37.002347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:37.101823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acdadd-f24a-4c74-9f4c-e84cbfe8d191 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:37.134341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:37.135162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:37.135445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:37.135743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:37.146330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:37.147790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:37.165796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:37.167069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:37.168231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:37.168231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:37.168231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:37.168231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:37.168231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 637/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:37.172907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:37.270056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b24a-c766-4815-b062-3e4082713f4a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:37.303130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:37.303870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:37.304132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:37.304427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:37.305183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:37.305514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:37.307643 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:37.319406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 629/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:37.325244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:37.423956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aca32-bc67-49c5-9af7-bc762ae0e7f9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:37.457507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:37.458312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:37.458613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:37.458879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:37.466449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:37.467920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:00:37.482929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:37.484163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:37.485159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 638/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:37.490120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:37.588574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143af2b5-febd-481f-b8ee-04da129cbd0a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:37.623471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:37.624150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:37.624458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:37.624739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:37.625586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:37.625898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:37.627358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:37.645431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 630/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:37.651391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:37.751475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68145-5297-497b-bf6f-5099c8c74dd0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:37.784667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:37.785529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:37.785813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:37.786085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:37.797252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:37.798698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:37.817207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:37.818373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:37.819802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:37.819802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:37.819802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:37.819802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:37.819802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 639/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:37.824594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:37.924358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c564b2c-5414-4e26-9943-eec5fafe1601 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:37.957895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:37.958562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:37.958842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:37.959144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:37.959861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:37.960187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:37.961546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:37.973140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 631/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:37.979652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:38.080418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b20979-d4fe-4fb4-accd-3d47faa427fa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:38.113968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:38.118868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:38.118868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:38.118868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:38.122023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:38.123510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:00:38.138259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:38.139374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:38.140339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 640/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 18:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:38.145350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:38.245263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585c4be-29b6-4c95-baa9-332de725c2f1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:38.279622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:38.280275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:38.280560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:38.280836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:38.281615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:38.281932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:38.283370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82421a-3f71-4166-87d5-431449e4bd14 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:38.295993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 632/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 18:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:38.302254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:38.398918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43d3f-c97c-4eb1-9567-44587cf08ac0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:38.432190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cff0c2-7d65-4d81-8682-500adddd133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:38.433187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff0c2-7d65-4d81-8682-500adddd133b None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:38.433471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff0c2-7d65-4d81-8682-500adddd133b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:38.433750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff0c2-7d65-4d81-8682-500adddd133b None admin] PATH_INFO: `/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/dd702379f5004159abc50fab8d398a6d/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:38.435803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cff0c2-7d65-4d81-8682-500adddd133b None admin] RBAC: Authorizing `identity:create_grant(project_id=da492a67660e4d75b1cf92a8e8e575c7, user_id=dd702379f5004159abc50fab8d398a6d, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:38.437233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cff0c2-7d65-4d81-8682-500adddd133b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:38.522473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 641/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 18:00:38 2022] PUT /identity/v3/projects/da492a67660e4d75b1cf92a8e8e575c7/users/dd702379f5004159abc50fab8d398a6d/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:00:40.846487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5efe5-23e5-4a43-ab57-995ac4b99c22 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:40.847106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5efe5-23e5-4a43-ab57-995ac4b99c22 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:40.847232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5efe5-23e5-4a43-ab57-995ac4b99c22 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:40.848611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 633/1274] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:40.854536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:40.854954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:40.855109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:40.871763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:40.875675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:40.939551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 642/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:00:40.963585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5efe5-23e5-4a43-ab57-995ac4b99c22 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:41.063259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5efe5-23e5-4a43-ab57-995ac4b99c22 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:41.097471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:41.098186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:41.098465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:41.098735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:41.109626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:00:41.116461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:41.118864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:41.119778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 634/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 18:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:41.123830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:41.220467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a34d8f-3253-4b12-8b1a-b59dcda5564e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:41.254842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:41.255557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:41.255840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:41.256114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:41.256873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:41.257177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:41.258732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:41.268712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 643/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 18:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:41.277142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:41.384521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ed4cd-96f5-4f5e-8e07-4ef000073427 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:41.422392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:41.423247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:41.423527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:41.423788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:41.436163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:41.437635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:41.455765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:41.456920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:41.458079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:41.458079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:41.458079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:41.458079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:41.458079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 635/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:00:41.463630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:41.562854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9edfd2-3413-40db-bd7c-414fd63af48a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:41.596051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:41.596722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:41.597002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:41.597279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:41.597999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:41.598298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:41.599701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:41.612697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 644/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:41.618379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:41.721239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bc140-3b77-42f8-bc16-db7b9d03ac6b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:41.755418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:41.756215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:41.756533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:41.756818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:41.765388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:41.766815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:00:41.781880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:41.783092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:41.784270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 636/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:41.788937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:41.888758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f1fbc-d4d1-45c3-8386-b25f8ff5f7a9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:41.922666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:41.923377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:41.923691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:41.923970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:41.924805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:41.925113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:41.926806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:41.944044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 645/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 18:00:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:41.950712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:42.048189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d0c7-8686-4091-9463-af49791331ec None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:42.080645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:42.081293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:42.081586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:42.081879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:42.149811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:42.151554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:42.249142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 637/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 18:00:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:00:42.254959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:42.352053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189fdbd-bbfd-4781-8ce8-5cf18c818beb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:42.385035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:42.385839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:42.386130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:42.386403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:42.396750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:42.398200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:00:42.415693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:42.416732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:42.417992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:00:42.417992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:00:42.417992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:00:42.417992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:42.417992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 646/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:42.422634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:42.518700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84fd7f-c4d9-4e10-bd36-0b747bd9bc53 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:42.551441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:42.552089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:42.552373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:42.552650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:42.553364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:42.553668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:42.555032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:42.566032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 638/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 18:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:42.572314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:42.670194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1850379-c52d-4efe-a8b8-d8a9e23dd302 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:42.704018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:42.704802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:42.705080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:42.705351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:42.711846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:42.714037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:00:42.727396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:42.729041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application May 04 18:00:42.730225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 647/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 18:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:42.735322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:42.833094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d92f-d0b7-4b5d-901d-bb4654db5da1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:42.866792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:42.867467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:42.867749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:42.868022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:42.869297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:42.869597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:42.871086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40e186-47c6-4289-a522-daf51573f4a5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:42.884714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 639/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 18:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:42.890838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:42.995442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2049-dfe2-4842-8ff0-2dc579a93e58 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:43.032406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:43.033065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:43.033350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:43.033625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:43.034449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] RBAC: Adding query filter params (role.id=e868f254ca154187867dcf5b7aa59a04, scope.project.id=da492a67660e4d75b1cf92a8e8e575c7, user.id=dd702379f5004159abc50fab8d398a6d) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:43.034762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:43.036254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a7be-be38-4f1b-aedf-97d31f26a0bd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:43.042637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 648/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 18:00:42 2022] GET /identity/v3/role_assignments?user.id=dd702379f5004159abc50fab8d398a6d&scope.project.id=da492a67660e4d75b1cf92a8e8e575c7&role.id=e868f254ca154187867dcf5b7aa59a04 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:45.396630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55135a-5c64-449d-a734-2a92110075ac None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:45.397385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55135a-5c64-449d-a734-2a92110075ac None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:45.397385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55135a-5c64-449d-a734-2a92110075ac None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:45.398671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 640/1288] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:45.405039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:45.405537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:45.405630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:45.424351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:45.425572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:45.494486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 649/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:45.517499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55135a-5c64-449d-a734-2a92110075ac None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:45.617469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55135a-5c64-449d-a734-2a92110075ac None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:45.652776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:45.653567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:45.653850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:45.654125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:45.654776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:45.656169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:45.668300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:45.669506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:45.670654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 641/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 18:00:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:00:45.677755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:45.773851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe7a45-1e5e-4f65-a3ec-10df68688311 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:45.809415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:45.810077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:45.810361 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:45.810636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:45.811369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:45.811673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:45.813277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c81d-1665-482f-9828-6cde22731a1c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:45.818049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 650/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 18:00:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:45.824548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:45.922079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c688e-0f19-41a8-92c6-a0c858887051 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:45.955976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:45.956630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:45.956913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:45.957187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:45.957925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:45.958212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:45.959588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3567d-a8d3-4e2b-bc2f-1d84275da4f9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:45.964006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 642/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 18:00:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:00:48.209044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7650-fe0f-447a-ae67-c55a3a3fa2eb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:48.209492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7650-fe0f-447a-ae67-c55a3a3fa2eb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:48.209652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7650-fe0f-447a-ae67-c55a3a3fa2eb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:48.211059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 651/1293] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:48.216787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5aab-f213-4f9a-a73f-3451ecc72e66 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:48.217205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5aab-f213-4f9a-a73f-3451ecc72e66 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:48.217325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5aab-f213-4f9a-a73f-3451ecc72e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:48.234324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5ace5aab-f213-4f9a-a73f-3451ecc72e66 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:48.235540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5ace5aab-f213-4f9a-a73f-3451ecc72e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:48.300623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 643/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:48.323357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7650-fe0f-447a-ae67-c55a3a3fa2eb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:48.422185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7650-fe0f-447a-ae67-c55a3a3fa2eb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:48.455163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b86d8-72fb-435a-a937-488c3ee463da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:48.455761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b86d8-72fb-435a-a937-488c3ee463da None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:48.456047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b86d8-72fb-435a-a937-488c3ee463da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:48.456327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b86d8-72fb-435a-a937-488c3ee463da None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:48.457042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b86d8-72fb-435a-a937-488c3ee463da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:48.458419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b86d8-72fb-435a-a937-488c3ee463da None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:48.552195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 652/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 18:00:48 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:00:50.881380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056358-9069-4375-a538-4f55cb36e5ce None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:50.882020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056358-9069-4375-a538-4f55cb36e5ce None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:50.882020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056358-9069-4375-a538-4f55cb36e5ce None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:50.883526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 644/1296] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:50.889162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:50.889596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:50.889715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:50.907899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:50.909092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:50.983907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 653/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:51.007785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056358-9069-4375-a538-4f55cb36e5ce None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:51.108009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056358-9069-4375-a538-4f55cb36e5ce None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:51.141407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:51.142122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:51.142407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:51.142683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:51.143362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:51.144731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:51.156456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:51.157710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:51.158620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 645/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 18:00:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:51.163809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:51.262496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338ca3-f11d-4227-8406-fe3bf73a3504 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:51.295646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:51.296313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:51.296595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:51.296871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:51.297571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:51.297877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:51.299265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:51.304497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 654/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 18:00:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:51.310982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:51.408939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575beab-5f17-43a6-8494-99f48aa8a39f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:51.441629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:51.442287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:51.442625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:51.442890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:51.443711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] RBAC: Adding query filter params (interface=public, service_id=75fe4272df894841b1557bcb06e9eae9, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:51.444021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:51.445374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fa05-7cfc-4551-8a48-56decde3bd6b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:51.451100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 646/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 18:00:51 2022] GET /identity/v3/endpoints?service_id=75fe4272df894841b1557bcb06e9eae9&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:51.457139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:51.560771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff0754-8680-4810-87b1-175f28d8caa0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:51.595550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e28e4-7863-409c-948f-0eb4ab8bd00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:51.596225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e28e4-7863-409c-948f-0eb4ab8bd00f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:51.596511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e28e4-7863-409c-948f-0eb4ab8bd00f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:51.596792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e28e4-7863-409c-948f-0eb4ab8bd00f None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:51.597565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e28e4-7863-409c-948f-0eb4ab8bd00f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:51.599012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e28e4-7863-409c-948f-0eb4ab8bd00f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:51.607085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 655/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 18:00:51 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:00:53.895384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec889e3-10df-4062-ba94-0842e5267071 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:53.895913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec889e3-10df-4062-ba94-0842e5267071 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:53.895913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec889e3-10df-4062-ba94-0842e5267071 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:53.897287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 647/1302] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:00:53.903211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:53.903697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:53.903826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:53.922575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:53.923806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:53.990750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 656/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:00:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:00:54.013975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec889e3-10df-4062-ba94-0842e5267071 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:54.116580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec889e3-10df-4062-ba94-0842e5267071 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:54.152011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:54.152741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:54.153027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:54.153305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:54.153957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:54.155341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:00:54.167668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:00:54.168872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application May 04 18:00:54.169756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 648/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 18:00:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:00:54.175020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:54.273324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076d8a-f553-4bed-b1c3-0214f8ca8cb0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:54.305975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:54.307189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:54.307473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:54.307752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:54.308443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:00:54.308749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:54.310113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e0b9f-43ee-4acd-9ff1-719abe507227 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:54.315084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 657/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 18:00:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:00:54.320934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:54.419088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c7aa-da65-42cb-9a99-8af2fdaeaf0b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:54.454122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2293f-4c78-48b1-af40-6cc2b6068f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:54.454821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2293f-4c78-48b1-af40-6cc2b6068f38 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:54.455145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2293f-4c78-48b1-af40-6cc2b6068f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:54.455430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2293f-4c78-48b1-af40-6cc2b6068f38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:54.456697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2293f-4c78-48b1-af40-6cc2b6068f38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:54.457561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2293f-4c78-48b1-af40-6cc2b6068f38 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:54.560053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 649/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 18:00:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:07:00.611802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f16b9-5487-4f17-b3de-722c96f89103 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:00.612398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f16b9-5487-4f17-b3de-722c96f89103 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:00.612398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f16b9-5487-4f17-b3de-722c96f89103 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:00.613886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 658/1307] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:00.618977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c83b-343b-4b5f-ab15-b513c6b85edd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:00.620026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c83b-343b-4b5f-ab15-b513c6b85edd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:00.620531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c83b-343b-4b5f-ab15-b513c6b85edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:00.708572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b914c83b-343b-4b5f-ab15-b513c6b85edd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:00.710140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b914c83b-343b-4b5f-ab15-b513c6b85edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:00.851455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 650/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:00.910596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948b17d-45ab-45ed-8ca9-1551e08fea80 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:00.910950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948b17d-45ab-45ed-8ca9-1551e08fea80 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:00.911319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948b17d-45ab-45ed-8ca9-1551e08fea80 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:00.913148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 659/1309] 10.222.0.23 () {54 vars in 964 bytes} [Wed May 4 18:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:00.921425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170939df-8fe2-483c-a809-67f66f522ff2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:00.921425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170939df-8fe2-483c-a809-67f66f522ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:00.921425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170939df-8fe2-483c-a809-67f66f522ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:01.055271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-170939df-8fe2-483c-a809-67f66f522ff2 None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:01.056485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-170939df-8fe2-483c-a809-67f66f522ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:01.135953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 651/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Wed May 4 18:07:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:01.146116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948b17d-45ab-45ed-8ca9-1551e08fea80 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:01.148968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3948b17d-45ab-45ed-8ca9-1551e08fea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:01.266525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948b17d-45ab-45ed-8ca9-1551e08fea80 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:01.340993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:01.341728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:01.342021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:01.342297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:01.344011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:01.460206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:01.461579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88579e3d-75c6-4c54-b6a4-95be967855d3 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:01.480829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 660/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:04.089821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68829f-c687-4d55-b544-f3befd1ccee5 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:04.090388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68829f-c687-4d55-b544-f3befd1ccee5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:04.090388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68829f-c687-4d55-b544-f3befd1ccee5 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:04.092774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 652/1312] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:04.098825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1331-7a75-4734-a3ea-8d73c0045cbc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:04.099384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1331-7a75-4734-a3ea-8d73c0045cbc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:04.099465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1331-7a75-4734-a3ea-8d73c0045cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:04.181641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a50c1331-7a75-4734-a3ea-8d73c0045cbc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:04.182792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a50c1331-7a75-4734-a3ea-8d73c0045cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:04.292804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 661/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:04.347933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96177a-f934-456a-8f4d-5604a198191e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:04.348260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96177a-f934-456a-8f4d-5604a198191e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:04.348496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96177a-f934-456a-8f4d-5604a198191e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:04.350153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 653/1314] 10.222.0.23 () {54 vars in 964 bytes} [Wed May 4 18:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:04.357631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b2a8-17f3-488a-ba14-55961d879e47 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:04.358006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b2a8-17f3-488a-ba14-55961d879e47 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:04.358313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b2a8-17f3-488a-ba14-55961d879e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:04.441568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6a00b2a8-17f3-488a-ba14-55961d879e47 None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:04.442751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a00b2a8-17f3-488a-ba14-55961d879e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:04.522264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 662/1315] 10.222.0.23 () {58 vars in 1061 bytes} [Wed May 4 18:07:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:04.532302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96177a-f934-456a-8f4d-5604a198191e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:04.533842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5a96177a-f934-456a-8f4d-5604a198191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:04.642335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96177a-f934-456a-8f4d-5604a198191e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:04.720264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:04.720843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:04.721125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:04.721400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:04.723186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:04.839336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:04.841050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e7fb-2af6-4c78-9d67-bbe97422fe25 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:04.859894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 654/1316] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:08.003134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518320e-9a83-4682-b8d8-2735af0f7c39 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:08.003698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518320e-9a83-4682-b8d8-2735af0f7c39 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:08.003698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518320e-9a83-4682-b8d8-2735af0f7c39 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:08.005056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 663/1317] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:08.010360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119be7-1351-4499-8d86-51eb9f8116c5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:08.010774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119be7-1351-4499-8d86-51eb9f8116c5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:08.010904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119be7-1351-4499-8d86-51eb9f8116c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:08.077176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8d119be7-1351-4499-8d86-51eb9f8116c5 None None] MFA Rules not processed for user `3cf21c9a897f4aadb9b2821d0a1b9b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:08.078386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8d119be7-1351-4499-8d86-51eb9f8116c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:08.172687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 655/1318] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:08.212566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518320e-9a83-4682-b8d8-2735af0f7c39 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:08.214116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7518320e-9a83-4682-b8d8-2735af0f7c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:08.321009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518320e-9a83-4682-b8d8-2735af0f7c39 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:08.392540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:08.393185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:08.393471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:08.393748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:08.395423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:08.501596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:08.503056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294ac60-18dc-452a-81c5-87ad8f1876e7 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:08.520935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 664/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:11.588658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02a983-d6f8-449a-a988-91b0dc02f27b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:11.589223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02a983-d6f8-449a-a988-91b0dc02f27b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:11.589223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02a983-d6f8-449a-a988-91b0dc02f27b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:11.590620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 656/1320] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:11.595878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fab73-d7d6-4370-b6a1-446fc902ef46 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:11.596291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fab73-d7d6-4370-b6a1-446fc902ef46 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:11.596414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fab73-d7d6-4370-b6a1-446fc902ef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:11.660301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-547fab73-d7d6-4370-b6a1-446fc902ef46 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:11.661529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-547fab73-d7d6-4370-b6a1-446fc902ef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:11.755525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 665/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:11.793752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02a983-d6f8-449a-a988-91b0dc02f27b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:11.795277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8b02a983-d6f8-449a-a988-91b0dc02f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:11.894683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02a983-d6f8-449a-a988-91b0dc02f27b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:11.967272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:11.967926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:11.968213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:11.968494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:11.970157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:12.077168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:12.078598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35e457-04fa-4c5e-85c3-28fc1aedeeaf service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:12.096498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 657/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:15.308406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897103-b396-458f-bb2e-b1f562a75872 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:15.309034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897103-b396-458f-bb2e-b1f562a75872 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:15.309034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897103-b396-458f-bb2e-b1f562a75872 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:15.310489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 666/1323] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:15.315959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81298-09c2-45b5-9df1-9e607866a9a9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:15.316388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81298-09c2-45b5-9df1-9e607866a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:15.316542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81298-09c2-45b5-9df1-9e607866a9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:15.380825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-53e81298-09c2-45b5-9df1-9e607866a9a9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:15.382032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-53e81298-09c2-45b5-9df1-9e607866a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:15.476959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 658/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:15.513820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897103-b396-458f-bb2e-b1f562a75872 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:15.515458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-50897103-b396-458f-bb2e-b1f562a75872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:15.617984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897103-b396-458f-bb2e-b1f562a75872 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:15.692203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:15.692770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:15.693053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:15.693331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:15.695009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:15.804708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:15.806154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464c5bf-50e2-4c98-b863-30e12dfbb148 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:15.825352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 667/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:18.170289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26d62-d8be-4fa2-8c79-ab2948ac7b24 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:18.170854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26d62-d8be-4fa2-8c79-ab2948ac7b24 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:18.170854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26d62-d8be-4fa2-8c79-ab2948ac7b24 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:18.172582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 659/1326] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:18.178263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227f0f-e483-4235-8b9d-2b7672e80be5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:18.178696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227f0f-e483-4235-8b9d-2b7672e80be5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:18.178818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227f0f-e483-4235-8b9d-2b7672e80be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:18.251024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2c227f0f-e483-4235-8b9d-2b7672e80be5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:18.252327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c227f0f-e483-4235-8b9d-2b7672e80be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:18.352336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 668/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:18.388516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26d62-d8be-4fa2-8c79-ab2948ac7b24 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:18.390113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-62c26d62-d8be-4fa2-8c79-ab2948ac7b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:18.493940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26d62-d8be-4fa2-8c79-ab2948ac7b24 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:18.566581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:18.567259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:18.567549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:18.567828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:18.569468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:18.677560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:18.678981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82e24-2672-4eeb-bb63-ebee90cab982 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:18.697245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 660/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:07:21.037031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7241-b54b-4e38-9c3e-a11734986f24 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:21.037578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7241-b54b-4e38-9c3e-a11734986f24 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:21.037578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7241-b54b-4e38-9c3e-a11734986f24 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:21.038938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 669/1329] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:21.045029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bbd32-6d62-4547-88d5-780e25bc5ef8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:21.045475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bbd32-6d62-4547-88d5-780e25bc5ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:21.045726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bbd32-6d62-4547-88d5-780e25bc5ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:21.110011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-568bbd32-6d62-4547-88d5-780e25bc5ef8 None None] MFA Rules not processed for user `3cf21c9a897f4aadb9b2821d0a1b9b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:21.111247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-568bbd32-6d62-4547-88d5-780e25bc5ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:21.205831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 661/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:21.244139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d7241-b54b-4e38-9c3e-a11734986f24 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:21.245721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b23d7241-b54b-4e38-9c3e-a11734986f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:21.351972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d7241-b54b-4e38-9c3e-a11734986f24 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:21.426965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:21.427643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:21.427969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:21.428228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:21.429904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:21.539867 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:21.541315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f42b9-a778-44f1-b8bf-af2d017b197a service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:21.559715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 670/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:24.219260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b9c6-a020-4574-a077-44cecc5655e0 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:24.219796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b9c6-a020-4574-a077-44cecc5655e0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:24.219931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b9c6-a020-4574-a077-44cecc5655e0 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:24.221353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 662/1332] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:24.226870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c2f9-c0bc-4296-97b4-5b46032a3285 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:24.227391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c2f9-c0bc-4296-97b4-5b46032a3285 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:24.227609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c2f9-c0bc-4296-97b4-5b46032a3285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:24.297290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-27e4c2f9-c0bc-4296-97b4-5b46032a3285 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:24.298425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27e4c2f9-c0bc-4296-97b4-5b46032a3285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:24.394125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 671/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:24.431166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b9c6-a020-4574-a077-44cecc5655e0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:24.433037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-efc3b9c6-a020-4574-a077-44cecc5655e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:24.544388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b9c6-a020-4574-a077-44cecc5655e0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:24.617931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:24.618574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:24.618856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:24.619163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:24.621470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:24.734452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:24.741891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9999-0bf3-483c-81de-674600a83ee0 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:24.756584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 663/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:27.098713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106511c3-8b28-4483-9f17-711224511c81 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:27.099310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106511c3-8b28-4483-9f17-711224511c81 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:27.099310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106511c3-8b28-4483-9f17-711224511c81 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:27.100666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 672/1335] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:27.106271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6ed0-ff5f-450b-abf6-5d832b656e54 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:27.106696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6ed0-ff5f-450b-abf6-5d832b656e54 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:27.106888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6ed0-ff5f-450b-abf6-5d832b656e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:27.168612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a25c6ed0-ff5f-450b-abf6-5d832b656e54 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:27.169791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a25c6ed0-ff5f-450b-abf6-5d832b656e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:27.263951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 664/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:27.304273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106511c3-8b28-4483-9f17-711224511c81 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:27.305895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-106511c3-8b28-4483-9f17-711224511c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:27.411035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106511c3-8b28-4483-9f17-711224511c81 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:27.486144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:27.486748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:27.487060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:27.487335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:27.488975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:27.595861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:27.597303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27f79-de1b-4750-8f3c-2b08230ee965 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:27.615452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 673/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:30.449973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959fb01-3816-4c6c-88f7-b51aef3726f3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:30.450471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959fb01-3816-4c6c-88f7-b51aef3726f3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:30.450587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959fb01-3816-4c6c-88f7-b51aef3726f3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:30.451945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 665/1338] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:07:30.457038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154827f4-efe6-4c3f-b200-94f4b4ad78ee None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:30.457463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154827f4-efe6-4c3f-b200-94f4b4ad78ee None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:30.457571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154827f4-efe6-4c3f-b200-94f4b4ad78ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:30.519847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-154827f4-efe6-4c3f-b200-94f4b4ad78ee None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:30.521023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-154827f4-efe6-4c3f-b200-94f4b4ad78ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:30.613754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 674/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:30.649497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959fb01-3816-4c6c-88f7-b51aef3726f3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:30.653170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f959fb01-3816-4c6c-88f7-b51aef3726f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:30.757857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959fb01-3816-4c6c-88f7-b51aef3726f3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:30.769624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:30.770261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:30.770543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:30.770818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:30.772425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:30.874487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:30.875948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679fbb-42c1-4fd8-8793-57a75e77dfe1 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:30.896702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 666/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:35.481263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5f78-929f-424c-b369-1c4d0189583c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:35.481826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5f78-929f-424c-b369-1c4d0189583c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:35.481826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5f78-929f-424c-b369-1c4d0189583c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:35.483209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 675/1341] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:35.488386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2009-5f20-41c7-8129-fdc3c659face None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:35.488818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2009-5f20-41c7-8129-fdc3c659face None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:35.488943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2009-5f20-41c7-8129-fdc3c659face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:35.536197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0f6e2009-5f20-41c7-8129-fdc3c659face None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:35.537349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0f6e2009-5f20-41c7-8129-fdc3c659face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:35.622333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 667/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:35.661113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5f78-929f-424c-b369-1c4d0189583c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:35.663338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-05cc5f78-929f-424c-b369-1c4d0189583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:35.687285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5f78-929f-424c-b369-1c4d0189583c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:35.691246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20545c-32ef-419f-af19-bdf187319bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:35.691896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20545c-32ef-419f-af19-bdf187319bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:35.692175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20545c-32ef-419f-af19-bdf187319bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:35.692451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20545c-32ef-419f-af19-bdf187319bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:35.701737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20545c-32ef-419f-af19-bdf187319bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:35.703199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20545c-32ef-419f-af19-bdf187319bf3 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:35.712637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 676/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:39.181318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe29f4-5b31-444e-98af-0c4e4f729977 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:39.181936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe29f4-5b31-444e-98af-0c4e4f729977 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:39.181936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe29f4-5b31-444e-98af-0c4e4f729977 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:39.183387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 668/1344] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:39.188687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024d3d-93d2-4d78-96c1-72a9e41541e2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:39.189148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024d3d-93d2-4d78-96c1-72a9e41541e2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:39.189243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024d3d-93d2-4d78-96c1-72a9e41541e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:39.223287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e3024d3d-93d2-4d78-96c1-72a9e41541e2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:39.224488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3024d3d-93d2-4d78-96c1-72a9e41541e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:39.233221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 677/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:39.269574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe29f4-5b31-444e-98af-0c4e4f729977 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:39.271299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cfbe29f4-5b31-444e-98af-0c4e4f729977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:39.284207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe29f4-5b31-444e-98af-0c4e4f729977 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:39.287681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1bbf-8796-449d-b861-31e679ee6d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:39.288318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1bbf-8796-449d-b861-31e679ee6d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:39.288598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1bbf-8796-449d-b861-31e679ee6d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:39.288874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1bbf-8796-449d-b861-31e679ee6d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:39.298554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1bbf-8796-449d-b861-31e679ee6d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:39.300003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1bbf-8796-449d-b861-31e679ee6d8a service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:39.309652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 669/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:44.718008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8908ab-4058-499a-aadb-e8f166ea9f6f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:44.718666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8908ab-4058-499a-aadb-e8f166ea9f6f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:44.718666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8908ab-4058-499a-aadb-e8f166ea9f6f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:44.720112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 678/1347] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:44.725522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93fbe-9849-419b-82bb-32d356944265 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:44.725993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93fbe-9849-419b-82bb-32d356944265 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:44.725993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93fbe-9849-419b-82bb-32d356944265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:44.744792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a5f93fbe-9849-419b-82bb-32d356944265 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:44.745986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a5f93fbe-9849-419b-82bb-32d356944265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:44.753971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 670/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:44.792201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8908ab-4058-499a-aadb-e8f166ea9f6f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:07:44.803753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8908ab-4058-499a-aadb-e8f166ea9f6f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:07:44.807419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde196b-ac22-4e88-a376-2c217fde73d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:07:44.808067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde196b-ac22-4e88-a376-2c217fde73d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:44.808354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde196b-ac22-4e88-a376-2c217fde73d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:44.808634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde196b-ac22-4e88-a376-2c217fde73d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:44.817573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde196b-ac22-4e88-a376-2c217fde73d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:07:44.819014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde196b-ac22-4e88-a376-2c217fde73d4 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:07:44.829412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 679/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:07:50.365173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1178f0-de97-4f84-819b-ca1723b193bc None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:50.365994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1178f0-de97-4f84-819b-ca1723b193bc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:50.366424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1178f0-de97-4f84-819b-ca1723b193bc None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:50.368389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 671/1350] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:50.373878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59057abc-6d44-44a1-9226-df6f105c05c5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:50.374694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59057abc-6d44-44a1-9226-df6f105c05c5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:50.375166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59057abc-6d44-44a1-9226-df6f105c05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:50.447188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-59057abc-6d44-44a1-9226-df6f105c05c5 None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:50.449553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-59057abc-6d44-44a1-9226-df6f105c05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:50.530511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 680/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:54.848057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da911f-5ee5-4849-9e05-cb50fffb27cf None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:54.848605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da911f-5ee5-4849-9e05-cb50fffb27cf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:54.848605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da911f-5ee5-4849-9e05-cb50fffb27cf None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:54.849977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 672/1352] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:54.855500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af8912-231d-4eb6-b984-333b9c69c69b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:54.855991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af8912-231d-4eb6-b984-333b9c69c69b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:54.856120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af8912-231d-4eb6-b984-333b9c69c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:54.876612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-87af8912-231d-4eb6-b984-333b9c69c69b None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:54.877820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-87af8912-231d-4eb6-b984-333b9c69c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:54.888815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 681/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:07:56.512998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97730d-506b-4635-a285-28ce96ef9d45 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:56.513503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97730d-506b-4635-a285-28ce96ef9d45 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:56.513503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97730d-506b-4635-a285-28ce96ef9d45 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:56.515195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 673/1354] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:07:56.520312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b11557-495a-4262-a0b9-ab691a7297a9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:07:56.520748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b11557-495a-4262-a0b9-ab691a7297a9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:07:56.520898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b11557-495a-4262-a0b9-ab691a7297a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:07:56.540627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-69b11557-495a-4262-a0b9-ab691a7297a9 None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:07:56.542345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-69b11557-495a-4262-a0b9-ab691a7297a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:07:56.551452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 682/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:07:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:00.503712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53f86-c8f9-4b03-a1b6-ed80da014041 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:00.504237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53f86-c8f9-4b03-a1b6-ed80da014041 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:00.504333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53f86-c8f9-4b03-a1b6-ed80da014041 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:00.505784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 674/1356] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:00.511464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be741-3f6d-46ea-b40e-6367bf6b41e9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:00.511952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be741-3f6d-46ea-b40e-6367bf6b41e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:00.512047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be741-3f6d-46ea-b40e-6367bf6b41e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:00.531741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-354be741-3f6d-46ea-b40e-6367bf6b41e9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:00.532933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-354be741-3f6d-46ea-b40e-6367bf6b41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:00.544261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 683/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:00.593485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1404f-3135-4dc7-9365-4c49dc5c24af None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:00.593779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1404f-3135-4dc7-9365-4c49dc5c24af None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:00.594063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1404f-3135-4dc7-9365-4c49dc5c24af None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:00.595794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 675/1358] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 18:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:00.601631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b89e3-4a1f-4152-a7b1-65eb29c8dad1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:00.601924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b89e3-4a1f-4152-a7b1-65eb29c8dad1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:00.602208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b89e3-4a1f-4152-a7b1-65eb29c8dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:00.660847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-416b89e3-4a1f-4152-a7b1-65eb29c8dad1 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:00.662038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-416b89e3-4a1f-4152-a7b1-65eb29c8dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:00.750870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 684/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 18:08:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:00.758936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1404f-3135-4dc7-9365-4c49dc5c24af None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:00.774006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1404f-3135-4dc7-9365-4c49dc5c24af None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:00.780666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad0fcf-f33f-4e47-b347-5211b91c911c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:00.781320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad0fcf-f33f-4e47-b347-5211b91c911c service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:00.781605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad0fcf-f33f-4e47-b347-5211b91c911c service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:00.781885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad0fcf-f33f-4e47-b347-5211b91c911c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:00.791269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad0fcf-f33f-4e47-b347-5211b91c911c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:00.792871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad0fcf-f33f-4e47-b347-5211b91c911c service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:00.804370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 676/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:03.373933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97ea9c-4b6d-4846-83a8-5c7ebe32383c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:03.374460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97ea9c-4b6d-4846-83a8-5c7ebe32383c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:03.374460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97ea9c-4b6d-4846-83a8-5c7ebe32383c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:03.375858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 685/1361] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:03.381152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0863c-5f72-4a37-bf5a-c14eaa3350ba None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:03.381568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0863c-5f72-4a37-bf5a-c14eaa3350ba None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:03.381743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0863c-5f72-4a37-bf5a-c14eaa3350ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:03.402906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e2e0863c-5f72-4a37-bf5a-c14eaa3350ba None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:03.404378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e2e0863c-5f72-4a37-bf5a-c14eaa3350ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:03.412467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 677/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:03.458360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97ea9c-4b6d-4846-83a8-5c7ebe32383c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:03.473905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97ea9c-4b6d-4846-83a8-5c7ebe32383c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:03.480991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664598-1766-4f15-8975-1edff8c5e743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:03.481516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664598-1766-4f15-8975-1edff8c5e743 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:03.481876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664598-1766-4f15-8975-1edff8c5e743 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:03.482227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664598-1766-4f15-8975-1edff8c5e743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:03.491762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664598-1766-4f15-8975-1edff8c5e743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:03.494623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664598-1766-4f15-8975-1edff8c5e743 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:03.504984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 686/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:06.270387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547053c-b78a-4d73-b40f-506b7806a5a7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:06.271276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547053c-b78a-4d73-b40f-506b7806a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:06.271563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547053c-b78a-4d73-b40f-506b7806a5a7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:06.272960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 678/1364] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:06.278743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af8d7-fd7d-4e9c-8f84-9533000dcabc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:06.279214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af8d7-fd7d-4e9c-8f84-9533000dcabc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:06.279355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af8d7-fd7d-4e9c-8f84-9533000dcabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:06.298295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f22af8d7-fd7d-4e9c-8f84-9533000dcabc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:06.300159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f22af8d7-fd7d-4e9c-8f84-9533000dcabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:06.308596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 687/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:06.355632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62535194-5fe0-4a46-8db7-929a9f082063 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:06.356010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62535194-5fe0-4a46-8db7-929a9f082063 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:06.356363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62535194-5fe0-4a46-8db7-929a9f082063 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:06.357852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 679/1366] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 18:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:06.363602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616302-e030-45d1-9da6-5ccebad4d8df None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:06.363890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616302-e030-45d1-9da6-5ccebad4d8df None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:06.364166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616302-e030-45d1-9da6-5ccebad4d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:06.382509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c4616302-e030-45d1-9da6-5ccebad4d8df None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:06.384272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c4616302-e030-45d1-9da6-5ccebad4d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:06.393614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 688/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 18:08:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:08:06.403602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62535194-5fe0-4a46-8db7-929a9f082063 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:06.424941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62535194-5fe0-4a46-8db7-929a9f082063 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:06.432022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee449-9ca9-482c-87f6-9d6e47108663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:06.440887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee449-9ca9-482c-87f6-9d6e47108663 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:06.441398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee449-9ca9-482c-87f6-9d6e47108663 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:06.441704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee449-9ca9-482c-87f6-9d6e47108663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:06.453852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee449-9ca9-482c-87f6-9d6e47108663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:06.455821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee449-9ca9-482c-87f6-9d6e47108663 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:06.467908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 680/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:08.835514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc13b-4744-4260-8574-d8a5ce65df50 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:08.836047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc13b-4744-4260-8574-d8a5ce65df50 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:08.836195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc13b-4744-4260-8574-d8a5ce65df50 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:08.838295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 689/1369] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:08.843763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8aeee-c876-4401-9b05-88c65e34e801 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:08.844228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8aeee-c876-4401-9b05-88c65e34e801 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:08.844228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8aeee-c876-4401-9b05-88c65e34e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:08.870544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dfb8aeee-c876-4401-9b05-88c65e34e801 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:08.872197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dfb8aeee-c876-4401-9b05-88c65e34e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:08.881293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 681/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:09.007486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a14403-de70-42a1-ab97-67c018ca6535 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:09.007778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a14403-de70-42a1-ab97-67c018ca6535 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:09.008980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a14403-de70-42a1-ab97-67c018ca6535 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:09.010536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 690/1371] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:09.015951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85e7a-8f9c-49d2-8dec-81e73ff75e5f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:09.016247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85e7a-8f9c-49d2-8dec-81e73ff75e5f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:09.016515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85e7a-8f9c-49d2-8dec-81e73ff75e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:09.034972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a1c85e7a-8f9c-49d2-8dec-81e73ff75e5f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:09.036195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a1c85e7a-8f9c-49d2-8dec-81e73ff75e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:09.044502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 682/1372] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:09.090355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a14403-de70-42a1-ab97-67c018ca6535 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:09.105208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a14403-de70-42a1-ab97-67c018ca6535 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:09.110592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1526-72e3-4183-8a3a-d8eaf37fdb96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:09.111272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1526-72e3-4183-8a3a-d8eaf37fdb96 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:09.111557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1526-72e3-4183-8a3a-d8eaf37fdb96 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:09.111835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1526-72e3-4183-8a3a-d8eaf37fdb96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:09.121120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1526-72e3-4183-8a3a-d8eaf37fdb96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:09.122720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1526-72e3-4183-8a3a-d8eaf37fdb96 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:09.132405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 691/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:09.193020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18da3-770e-4b33-9071-31860c09687b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:09.193405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18da3-770e-4b33-9071-31860c09687b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:09.193745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18da3-770e-4b33-9071-31860c09687b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:09.195286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 683/1374] 10.222.0.23 () {54 vars in 963 bytes} [Wed May 4 18:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:09.200472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae2dcb-2280-4857-9fa5-45c55a0098d4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:09.202522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae2dcb-2280-4857-9fa5-45c55a0098d4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:09.202522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae2dcb-2280-4857-9fa5-45c55a0098d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:09.256371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fcae2dcb-2280-4857-9fa5-45c55a0098d4 None None] MFA Rules not processed for user `e7ee1066de2a40f988f50b9b48a0ac5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:09.257559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fcae2dcb-2280-4857-9fa5-45c55a0098d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:09.320038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 692/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Wed May 4 18:08:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:09.328649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18da3-770e-4b33-9071-31860c09687b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:09.341267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18da3-770e-4b33-9071-31860c09687b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:09.344815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4473feb-b689-4979-8246-15590e092ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:09.345464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473feb-b689-4979-8246-15590e092ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:09.345748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473feb-b689-4979-8246-15590e092ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:09.346096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473feb-b689-4979-8246-15590e092ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:09.358035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473feb-b689-4979-8246-15590e092ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:09.361134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473feb-b689-4979-8246-15590e092ee0 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:09.375130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 684/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:11.612975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62f3c2-f7dc-455c-b9d9-9c728ef2a2e0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:11.613481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62f3c2-f7dc-455c-b9d9-9c728ef2a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:11.613578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62f3c2-f7dc-455c-b9d9-9c728ef2a2e0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:11.615149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 693/1377] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:11.621377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958cad-137a-48ea-a34e-9ea154ae2ecf None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:11.621869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958cad-137a-48ea-a34e-9ea154ae2ecf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:11.621991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958cad-137a-48ea-a34e-9ea154ae2ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:11.639874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a2958cad-137a-48ea-a34e-9ea154ae2ecf None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:11.641443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a2958cad-137a-48ea-a34e-9ea154ae2ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:11.649035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 685/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:11.694801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62f3c2-f7dc-455c-b9d9-9c728ef2a2e0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:11.712919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62f3c2-f7dc-455c-b9d9-9c728ef2a2e0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:11.721941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5b659-3a5f-41f2-aac8-c096c8fa6c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:11.721941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5b659-3a5f-41f2-aac8-c096c8fa6c50 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:11.721941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5b659-3a5f-41f2-aac8-c096c8fa6c50 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:11.721941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5b659-3a5f-41f2-aac8-c096c8fa6c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:11.735558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5b659-3a5f-41f2-aac8-c096c8fa6c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:11.737561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5b659-3a5f-41f2-aac8-c096c8fa6c50 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:11.749149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 694/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:14.270152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d13a5-e256-4ef2-9600-e39fbdf672cd None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:14.270691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d13a5-e256-4ef2-9600-e39fbdf672cd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:14.270691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d13a5-e256-4ef2-9600-e39fbdf672cd None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:14.272123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 686/1380] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:14.277572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1af0b-644f-4d61-8c3f-5eebb5e56002 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:14.278018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1af0b-644f-4d61-8c3f-5eebb5e56002 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:14.278121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1af0b-644f-4d61-8c3f-5eebb5e56002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:14.296021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-18d1af0b-644f-4d61-8c3f-5eebb5e56002 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:14.297200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-18d1af0b-644f-4d61-8c3f-5eebb5e56002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:14.307441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 695/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:14.352880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d13a5-e256-4ef2-9600-e39fbdf672cd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:14.368596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d13a5-e256-4ef2-9600-e39fbdf672cd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:14.374181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee63661-2a0e-419c-8bc2-e6aaa564dbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:14.374813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee63661-2a0e-419c-8bc2-e6aaa564dbe7 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:14.375124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee63661-2a0e-419c-8bc2-e6aaa564dbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:14.375399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee63661-2a0e-419c-8bc2-e6aaa564dbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:14.384185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee63661-2a0e-419c-8bc2-e6aaa564dbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:14.385764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee63661-2a0e-419c-8bc2-e6aaa564dbe7 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:14.395722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 687/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:16.938626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c032-f0cf-44ee-a0e3-719ea0a6f6b7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:16.939685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c032-f0cf-44ee-a0e3-719ea0a6f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:16.939685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c032-f0cf-44ee-a0e3-719ea0a6f6b7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:16.940543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 696/1383] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:08:16.945983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceab3a-84df-4aec-af5d-a5e098dad47e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:16.946429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceab3a-84df-4aec-af5d-a5e098dad47e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:16.946759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceab3a-84df-4aec-af5d-a5e098dad47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:16.965222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-77ceab3a-84df-4aec-af5d-a5e098dad47e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:16.966328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-77ceab3a-84df-4aec-af5d-a5e098dad47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:16.974283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 688/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:17.018682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477c032-f0cf-44ee-a0e3-719ea0a6f6b7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:17.033866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477c032-f0cf-44ee-a0e3-719ea0a6f6b7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:17.040076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ccdd0-251f-48de-940e-f6e0b6349c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:17.040720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ccdd0-251f-48de-940e-f6e0b6349c26 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:17.041000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ccdd0-251f-48de-940e-f6e0b6349c26 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:17.041278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ccdd0-251f-48de-940e-f6e0b6349c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:17.049891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ccdd0-251f-48de-940e-f6e0b6349c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:17.051533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ccdd0-251f-48de-940e-f6e0b6349c26 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:17.061835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 697/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:19.325710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc381-1bbc-416f-8a8a-d40bd1d05a05 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:19.326376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc381-1bbc-416f-8a8a-d40bd1d05a05 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:19.326376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc381-1bbc-416f-8a8a-d40bd1d05a05 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:19.327652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 689/1386] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:08:19.332921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedea30-c2e2-4ad2-86ac-60bb877932d5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:19.333516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedea30-c2e2-4ad2-86ac-60bb877932d5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:19.333516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedea30-c2e2-4ad2-86ac-60bb877932d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:19.352260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fcedea30-c2e2-4ad2-86ac-60bb877932d5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:19.353447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fcedea30-c2e2-4ad2-86ac-60bb877932d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:19.361518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 698/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:08:19.407810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc381-1bbc-416f-8a8a-d40bd1d05a05 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:19.426168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc381-1bbc-416f-8a8a-d40bd1d05a05 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:19.434925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab06dc0-da38-439a-a37c-1d1d37e87b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:19.436028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06dc0-da38-439a-a37c-1d1d37e87b97 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:19.436595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06dc0-da38-439a-a37c-1d1d37e87b97 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:19.437042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06dc0-da38-439a-a37c-1d1d37e87b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:19.449765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06dc0-da38-439a-a37c-1d1d37e87b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:19.452517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06dc0-da38-439a-a37c-1d1d37e87b97 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:19.467109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 690/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:08:21.947476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a7d7-9682-4196-91a6-46a696272f99 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:21.947935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a7d7-9682-4196-91a6-46a696272f99 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:21.948022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a7d7-9682-4196-91a6-46a696272f99 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:21.949378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 699/1389] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:21.954565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014f95c-0e5b-4e30-961e-b1810dad961f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:21.955032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014f95c-0e5b-4e30-961e-b1810dad961f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:21.955131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014f95c-0e5b-4e30-961e-b1810dad961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:21.972737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1014f95c-0e5b-4e30-961e-b1810dad961f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:21.973930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1014f95c-0e5b-4e30-961e-b1810dad961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:21.982019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 691/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:08:22.026693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a7d7-9682-4196-91a6-46a696272f99 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:22.045931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a7d7-9682-4196-91a6-46a696272f99 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:22.054352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe627a-9e95-41a3-b9b4-1d4d37fc6a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:22.055445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe627a-9e95-41a3-b9b4-1d4d37fc6a14 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:22.055812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe627a-9e95-41a3-b9b4-1d4d37fc6a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:22.056244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe627a-9e95-41a3-b9b4-1d4d37fc6a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:22.067332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe627a-9e95-41a3-b9b4-1d4d37fc6a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:22.070731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe627a-9e95-41a3-b9b4-1d4d37fc6a14 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:22.083689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 700/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:24.693719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21791-9711-4c04-83a2-bd7f05da08c4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:24.694318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21791-9711-4c04-83a2-bd7f05da08c4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:24.694318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21791-9711-4c04-83a2-bd7f05da08c4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:24.696178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 692/1392] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:24.701677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8deac-28bc-4e43-b1f5-2393c1f5e921 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:24.702134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8deac-28bc-4e43-b1f5-2393c1f5e921 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:24.702274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8deac-28bc-4e43-b1f5-2393c1f5e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:24.721140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5ca8deac-28bc-4e43-b1f5-2393c1f5e921 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:24.722262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ca8deac-28bc-4e43-b1f5-2393c1f5e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:24.731225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 701/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:08:24.776769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21791-9711-4c04-83a2-bd7f05da08c4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:24.791520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21791-9711-4c04-83a2-bd7f05da08c4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:24.796833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa186a-59ee-432a-af8d-70a364c15958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:24.797473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa186a-59ee-432a-af8d-70a364c15958 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:24.798008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa186a-59ee-432a-af8d-70a364c15958 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:24.798292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa186a-59ee-432a-af8d-70a364c15958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:24.807386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa186a-59ee-432a-af8d-70a364c15958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:24.808959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa186a-59ee-432a-af8d-70a364c15958 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:24.818267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 693/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:25.803159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ff31-75e9-4157-aed9-8c32cd0c49e9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:25.803756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ff31-75e9-4157-aed9-8c32cd0c49e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:25.803756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ff31-75e9-4157-aed9-8c32cd0c49e9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:25.805195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 702/1395] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:25.810439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51458db6-1525-41ec-a825-2aebc46d9ac7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:25.810881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51458db6-1525-41ec-a825-2aebc46d9ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:25.811199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51458db6-1525-41ec-a825-2aebc46d9ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:25.829397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-51458db6-1525-41ec-a825-2aebc46d9ac7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:25.830624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-51458db6-1525-41ec-a825-2aebc46d9ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:25.839029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 694/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:25.895790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241e32-728e-4e97-99ef-08034bf9e543 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:25.896073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241e32-728e-4e97-99ef-08034bf9e543 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:25.896357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241e32-728e-4e97-99ef-08034bf9e543 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:25.898305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 703/1397] 10.222.0.23 () {54 vars in 962 bytes} [Wed May 4 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:25.903309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6abfb-d81c-48a2-aece-e5a1c0581578 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:25.903615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6abfb-d81c-48a2-aece-e5a1c0581578 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:25.903887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6abfb-d81c-48a2-aece-e5a1c0581578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:25.951091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-08a6abfb-d81c-48a2-aece-e5a1c0581578 None None] MFA Rules not processed for user `4c7559dd645048dd99a4b8a5d3537230`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:25.952291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-08a6abfb-d81c-48a2-aece-e5a1c0581578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:26.013348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 695/1398] 10.222.0.23 () {58 vars in 1059 bytes} [Wed May 4 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:26.020912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241e32-728e-4e97-99ef-08034bf9e543 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:26.032384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241e32-728e-4e97-99ef-08034bf9e543 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:26.035954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edaa11-763a-44d4-8256-64e4f473619b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:26.036598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edaa11-763a-44d4-8256-64e4f473619b service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:26.036922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edaa11-763a-44d4-8256-64e4f473619b service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:26.037204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edaa11-763a-44d4-8256-64e4f473619b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:26.047613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edaa11-763a-44d4-8256-64e4f473619b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:26.049343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edaa11-763a-44d4-8256-64e4f473619b service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:26.060209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 704/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:26.620647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706373e1-b47e-4be5-a15d-875e62729862 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:26.620940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706373e1-b47e-4be5-a15d-875e62729862 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:26.621224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706373e1-b47e-4be5-a15d-875e62729862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:26.676091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-706373e1-b47e-4be5-a15d-875e62729862 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:26.677312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-706373e1-b47e-4be5-a15d-875e62729862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:26.745578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 696/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:26.791625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468fd2b-279a-4543-9406-2dd5baaa0cbb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:26.791999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468fd2b-279a-4543-9406-2dd5baaa0cbb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:26.792345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468fd2b-279a-4543-9406-2dd5baaa0cbb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:26.793775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 705/1401] 10.222.0.23 () {54 vars in 942 bytes} [Wed May 4 18:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:26.800768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224252-3af4-417f-b1bd-73ea3d0b31cb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:26.801063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224252-3af4-417f-b1bd-73ea3d0b31cb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:26.801350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224252-3af4-417f-b1bd-73ea3d0b31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:26.853055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-93224252-3af4-417f-b1bd-73ea3d0b31cb None None] MFA Rules not processed for user `14ec426f2eb64bb4b480b5ad42a43410`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:26.854262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-93224252-3af4-417f-b1bd-73ea3d0b31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:26.928549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 697/1402] 10.222.0.23 () {58 vars in 1039 bytes} [Wed May 4 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:26.939080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468fd2b-279a-4543-9406-2dd5baaa0cbb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:26.953409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468fd2b-279a-4543-9406-2dd5baaa0cbb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:26.958480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9140c5a-3571-49b7-9aac-005d7cc5691f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:26.959208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140c5a-3571-49b7-9aac-005d7cc5691f service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:26.964499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140c5a-3571-49b7-9aac-005d7cc5691f service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:26.964499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140c5a-3571-49b7-9aac-005d7cc5691f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:26.968956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9140c5a-3571-49b7-9aac-005d7cc5691f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:26.970698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9140c5a-3571-49b7-9aac-005d7cc5691f service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:26.979197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 706/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:08:27.265358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ec27-9096-4604-813c-ebb9dd9fe58e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:27.265650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ec27-9096-4604-813c-ebb9dd9fe58e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:27.265960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ec27-9096-4604-813c-ebb9dd9fe58e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:27.267399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 698/1404] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:27.273120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9980-0259-4656-9eb5-23fc03c202bc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:27.273467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9980-0259-4656-9eb5-23fc03c202bc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:27.273760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9980-0259-4656-9eb5-23fc03c202bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:27.291728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-098e9980-0259-4656-9eb5-23fc03c202bc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:27.292944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-098e9980-0259-4656-9eb5-23fc03c202bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:27.301512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 707/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:27.346818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ec27-9096-4604-813c-ebb9dd9fe58e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:27.361112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ec27-9096-4604-813c-ebb9dd9fe58e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:27.366432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975495-e599-4a0e-9836-1e5ea1173eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:27.370980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975495-e599-4a0e-9836-1e5ea1173eb6 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:27.370980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975495-e599-4a0e-9836-1e5ea1173eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:27.370980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975495-e599-4a0e-9836-1e5ea1173eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:27.375743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975495-e599-4a0e-9836-1e5ea1173eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:27.377354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975495-e599-4a0e-9836-1e5ea1173eb6 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:27.387497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 699/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:29.856263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51de4c4-2737-4db4-b080-27257f77fdca None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:29.856838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51de4c4-2737-4db4-b080-27257f77fdca None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:29.856838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51de4c4-2737-4db4-b080-27257f77fdca None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:29.858182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 708/1407] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:29.863498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d905-a343-4866-8d69-0640d9d3bf96 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:29.867224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d905-a343-4866-8d69-0640d9d3bf96 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:29.867709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d905-a343-4866-8d69-0640d9d3bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:29.887356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1be1d905-a343-4866-8d69-0640d9d3bf96 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:29.888713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1be1d905-a343-4866-8d69-0640d9d3bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:29.907746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 700/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:29.945293 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51de4c4-2737-4db4-b080-27257f77fdca None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:29.960840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51de4c4-2737-4db4-b080-27257f77fdca None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:29.966449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52d8d6-e143-4c3d-831c-fea88ce5919b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:29.972937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52d8d6-e143-4c3d-831c-fea88ce5919b service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:29.972937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52d8d6-e143-4c3d-831c-fea88ce5919b service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:29.972937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52d8d6-e143-4c3d-831c-fea88ce5919b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:29.978710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52d8d6-e143-4c3d-831c-fea88ce5919b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:29.978710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52d8d6-e143-4c3d-831c-fea88ce5919b service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:29.988641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 709/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:51.350507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522feb-4c12-412f-9abc-f585bd7f1bdd None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:51.351251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522feb-4c12-412f-9abc-f585bd7f1bdd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:51.351251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522feb-4c12-412f-9abc-f585bd7f1bdd None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:51.352458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 701/1410] 10.222.0.23 () {54 vars in 918 bytes} [Wed May 4 18:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:51.358000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d00c0-bdaa-4fd5-b901-e0edb870ae02 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:51.358521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d00c0-bdaa-4fd5-b901-e0edb870ae02 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:51.358723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d00c0-bdaa-4fd5-b901-e0edb870ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:51.381667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4c1d00c0-bdaa-4fd5-b901-e0edb870ae02 None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:51.383197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4c1d00c0-bdaa-4fd5-b901-e0edb870ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:51.393343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 710/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Wed May 4 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:51.409310 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff26d-adc1-4ad5-8159-8f4abfaf1f23 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:51.409601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff26d-adc1-4ad5-8159-8f4abfaf1f23 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:51.409881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff26d-adc1-4ad5-8159-8f4abfaf1f23 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:51.411351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 702/1412] 10.222.0.23 () {54 vars in 918 bytes} [Wed May 4 18:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:51.417072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeb49f-d221-4e8a-bd94-fc73406d1435 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:51.417369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeb49f-d221-4e8a-bd94-fc73406d1435 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:51.417674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeb49f-d221-4e8a-bd94-fc73406d1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:51.438645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5aaeb49f-d221-4e8a-bd94-fc73406d1435 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:51.440489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5aaeb49f-d221-4e8a-bd94-fc73406d1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:51.450498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 711/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Wed May 4 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:54.204602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f310-a9fa-4eb3-b9eb-03542e42943f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:54.205140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f310-a9fa-4eb3-b9eb-03542e42943f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:54.205238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f310-a9fa-4eb3-b9eb-03542e42943f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:54.206625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:54.212892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bd948-6be6-45ca-aa7d-3e8572ae2df4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:54.213374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bd948-6be6-45ca-aa7d-3e8572ae2df4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:54.213475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bd948-6be6-45ca-aa7d-3e8572ae2df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:54.231667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-548bd948-6be6-45ca-aa7d-3e8572ae2df4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:54.232849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-548bd948-6be6-45ca-aa7d-3e8572ae2df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:54.240693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:54.283530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864f310-a9fa-4eb3-b9eb-03542e42943f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:54.298094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864f310-a9fa-4eb3-b9eb-03542e42943f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:54.303825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b30348-b87a-4aa0-8357-a94ba9d7ebfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:54.304460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b30348-b87a-4aa0-8357-a94ba9d7ebfa service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:54.304745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b30348-b87a-4aa0-8357-a94ba9d7ebfa service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:54.305022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b30348-b87a-4aa0-8357-a94ba9d7ebfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:54.313082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b30348-b87a-4aa0-8357-a94ba9d7ebfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:54.314650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b30348-b87a-4aa0-8357-a94ba9d7ebfa service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:54.324956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 704/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:55.644537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed85a-4446-41ed-8bec-8792f75b8fd6 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:55.645121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed85a-4446-41ed-8bec-8792f75b8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:55.645121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed85a-4446-41ed-8bec-8792f75b8fd6 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:55.646644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:55.651691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724aca1-0193-421a-b4ea-611595604205 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:55.652087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724aca1-0193-421a-b4ea-611595604205 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:55.652259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724aca1-0193-421a-b4ea-611595604205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:55.669803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b724aca1-0193-421a-b4ea-611595604205 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:55.671435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b724aca1-0193-421a-b4ea-611595604205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:55.681611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:55.859473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed85a-4446-41ed-8bec-8792f75b8fd6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:55.874212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed85a-4446-41ed-8bec-8792f75b8fd6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:55.879924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d3d7-8e57-45f8-b211-93c05317ae5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:55.880564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d3d7-8e57-45f8-b211-93c05317ae5d service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:55.880850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d3d7-8e57-45f8-b211-93c05317ae5d service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:55.881130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d3d7-8e57-45f8-b211-93c05317ae5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:55.889272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d3d7-8e57-45f8-b211-93c05317ae5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:55.890851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d3d7-8e57-45f8-b211-93c05317ae5d service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:55.900379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 714/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:57.186312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130c32e-1da2-4a48-ab63-a86099b5fa95 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:57.186919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130c32e-1da2-4a48-ab63-a86099b5fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:57.186919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130c32e-1da2-4a48-ab63-a86099b5fa95 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:57.188264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:57.193259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66a37-4eba-4403-9a6e-eaf09d5683ab None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:57.193681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66a37-4eba-4403-9a6e-eaf09d5683ab None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:57.193823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66a37-4eba-4403-9a6e-eaf09d5683ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:57.212403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7df66a37-4eba-4403-9a6e-eaf09d5683ab None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:57.213576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7df66a37-4eba-4403-9a6e-eaf09d5683ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:57.221497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:57.374505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130c32e-1da2-4a48-ab63-a86099b5fa95 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:57.390389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130c32e-1da2-4a48-ab63-a86099b5fa95 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:57.396815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554b69d-cf26-4aa9-a171-a3a4df2b4013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:57.397449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b69d-cf26-4aa9-a171-a3a4df2b4013 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:57.397735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b69d-cf26-4aa9-a171-a3a4df2b4013 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:57.398017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b69d-cf26-4aa9-a171-a3a4df2b4013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:57.405975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554b69d-cf26-4aa9-a171-a3a4df2b4013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:57.407629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554b69d-cf26-4aa9-a171-a3a4df2b4013 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:57.418152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 707/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:08:58.663404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52751-07a7-4428-80d4-726a362eb656 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:58.663940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52751-07a7-4428-80d4-726a362eb656 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:58.663940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52751-07a7-4428-80d4-726a362eb656 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:58.665309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:08:58.670075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26afa21-49ec-4cca-8d23-ef49095c6f58 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:58.670500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26afa21-49ec-4cca-8d23-ef49095c6f58 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:58.670628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26afa21-49ec-4cca-8d23-ef49095c6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:58.689172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f26afa21-49ec-4cca-8d23-ef49095c6f58 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:08:58.690394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f26afa21-49ec-4cca-8d23-ef49095c6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:08:58.699089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:08:58.852056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e52751-07a7-4428-80d4-726a362eb656 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:08:58.867813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e52751-07a7-4428-80d4-726a362eb656 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:08:58.873196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae1ddf-ecde-40ba-ad1c-bb6632b5257d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:08:58.873834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1ddf-ecde-40ba-ad1c-bb6632b5257d service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:08:58.874119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1ddf-ecde-40ba-ad1c-bb6632b5257d service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:08:58.874398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1ddf-ecde-40ba-ad1c-bb6632b5257d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:08:58.882536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1ddf-ecde-40ba-ad1c-bb6632b5257d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:08:58.884163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1ddf-ecde-40ba-ad1c-bb6632b5257d service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:08:58.893353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 717/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:09:00.151887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4122-5a45-4c6a-8b13-30eb74a2a0a9 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:00.152455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4122-5a45-4c6a-8b13-30eb74a2a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:00.152455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4122-5a45-4c6a-8b13-30eb74a2a0a9 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:00.153811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:00.158780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d099dbc-f2d1-4562-81f6-394a1cff4be8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:00.159255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d099dbc-f2d1-4562-81f6-394a1cff4be8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:00.159395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d099dbc-f2d1-4562-81f6-394a1cff4be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:00.178017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3d099dbc-f2d1-4562-81f6-394a1cff4be8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:00.179221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d099dbc-f2d1-4562-81f6-394a1cff4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:00.186890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:00.337582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4122-5a45-4c6a-8b13-30eb74a2a0a9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:00.352011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4122-5a45-4c6a-8b13-30eb74a2a0a9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:00.357315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4060e-0754-4833-a94d-79609b3cf2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:00.357950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4060e-0754-4833-a94d-79609b3cf2a5 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:00.358235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4060e-0754-4833-a94d-79609b3cf2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:00.358514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4060e-0754-4833-a94d-79609b3cf2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:00.366974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4060e-0754-4833-a94d-79609b3cf2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:00.368586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4060e-0754-4833-a94d-79609b3cf2a5 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:00.377711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 710/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:01.686334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8e42-f6b8-4530-8cbb-358bb476840f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:01.686912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8e42-f6b8-4530-8cbb-358bb476840f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:01.686912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8e42-f6b8-4530-8cbb-358bb476840f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:01.688361 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:01.693468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c79f5-da9b-4713-bbee-c20cf691e2cb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:01.693915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c79f5-da9b-4713-bbee-c20cf691e2cb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:01.694035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c79f5-da9b-4713-bbee-c20cf691e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:01.712669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-611c79f5-da9b-4713-bbee-c20cf691e2cb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:01.714304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-611c79f5-da9b-4713-bbee-c20cf691e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:01.725348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:01.875188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc8e42-f6b8-4530-8cbb-358bb476840f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:01.890444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc8e42-f6b8-4530-8cbb-358bb476840f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:01.896597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ab2bb-fc8d-4600-bf00-d1cc41d24ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:01.897237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ab2bb-fc8d-4600-bf00-d1cc41d24ccc service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:01.897524 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ab2bb-fc8d-4600-bf00-d1cc41d24ccc service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:01.897805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ab2bb-fc8d-4600-bf00-d1cc41d24ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:01.906131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ab2bb-fc8d-4600-bf00-d1cc41d24ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:01.907773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ab2bb-fc8d-4600-bf00-d1cc41d24ccc service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:01.917329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 720/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:03.220683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254f265-49e6-436a-adb3-2f70b16a71d8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:03.221192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254f265-49e6-436a-adb3-2f70b16a71d8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:03.221292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254f265-49e6-436a-adb3-2f70b16a71d8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:03.222619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:03.228697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748437e9-b518-48ca-bddd-59415a9e665d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:03.229153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748437e9-b518-48ca-bddd-59415a9e665d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:03.229253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748437e9-b518-48ca-bddd-59415a9e665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:03.247913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-748437e9-b518-48ca-bddd-59415a9e665d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:03.249135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-748437e9-b518-48ca-bddd-59415a9e665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:03.257777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:03.407421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254f265-49e6-436a-adb3-2f70b16a71d8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:03.423397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254f265-49e6-436a-adb3-2f70b16a71d8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:03.429363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1081a3-98f0-471f-804e-66d3bdc8e509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:03.430000 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1081a3-98f0-471f-804e-66d3bdc8e509 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:03.430289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1081a3-98f0-471f-804e-66d3bdc8e509 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:03.430571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1081a3-98f0-471f-804e-66d3bdc8e509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:03.438977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1081a3-98f0-471f-804e-66d3bdc8e509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:03.440590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1081a3-98f0-471f-804e-66d3bdc8e509 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:03.451255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 713/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:04.726973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376fb91-38d3-4f7e-804f-3afe44db8b90 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:04.727546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376fb91-38d3-4f7e-804f-3afe44db8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:04.727676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376fb91-38d3-4f7e-804f-3afe44db8b90 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:04.729002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:04.734121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f643a-34ae-4c6d-8b9b-32d5d04b6766 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:04.734582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f643a-34ae-4c6d-8b9b-32d5d04b6766 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:04.734693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f643a-34ae-4c6d-8b9b-32d5d04b6766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:04.752720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-630f643a-34ae-4c6d-8b9b-32d5d04b6766 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:04.754411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-630f643a-34ae-4c6d-8b9b-32d5d04b6766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:04.762601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:04.911589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376fb91-38d3-4f7e-804f-3afe44db8b90 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:04.925721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376fb91-38d3-4f7e-804f-3afe44db8b90 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:04.931720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7bb4-35a6-424b-be7d-669eb91f06ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:04.932357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7bb4-35a6-424b-be7d-669eb91f06ce service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:04.932641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7bb4-35a6-424b-be7d-669eb91f06ce service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:04.932920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7bb4-35a6-424b-be7d-669eb91f06ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:04.940992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d7bb4-35a6-424b-be7d-669eb91f06ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:04.942639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d7bb4-35a6-424b-be7d-669eb91f06ce service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:04.951846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 723/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:06.245356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07cc47-1eff-420a-b7a9-53278e528b68 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:06.245918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07cc47-1eff-420a-b7a9-53278e528b68 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:06.245918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07cc47-1eff-420a-b7a9-53278e528b68 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:06.247319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:06.252575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aa46d-490b-4eeb-81a9-c82e2e176dce None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:06.253057 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aa46d-490b-4eeb-81a9-c82e2e176dce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:06.253138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aa46d-490b-4eeb-81a9-c82e2e176dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:06.273303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c36aa46d-490b-4eeb-81a9-c82e2e176dce None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:06.275112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c36aa46d-490b-4eeb-81a9-c82e2e176dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:06.282464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:06.438346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07cc47-1eff-420a-b7a9-53278e528b68 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:06.452992 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07cc47-1eff-420a-b7a9-53278e528b68 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:06.458493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bc1dd-bda7-49e5-ba36-452a73145c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:06.459096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bc1dd-bda7-49e5-ba36-452a73145c79 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:06.459384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bc1dd-bda7-49e5-ba36-452a73145c79 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:06.459665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bc1dd-bda7-49e5-ba36-452a73145c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:06.467620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bc1dd-bda7-49e5-ba36-452a73145c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:06.469216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bc1dd-bda7-49e5-ba36-452a73145c79 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:06.479332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 716/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:08.630847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda993c-0b1a-467b-8026-c90afbdad2e4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:08.631463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda993c-0b1a-467b-8026-c90afbdad2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:08.631463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda993c-0b1a-467b-8026-c90afbdad2e4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:08.632820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:08.638107 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8657ffc-cc6a-4678-83b4-94b74e675b00 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:08.638505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8657ffc-cc6a-4678-83b4-94b74e675b00 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:08.638675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8657ffc-cc6a-4678-83b4-94b74e675b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:08.656916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b8657ffc-cc6a-4678-83b4-94b74e675b00 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:08.658108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b8657ffc-cc6a-4678-83b4-94b74e675b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:08.666303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:08.704814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda993c-0b1a-467b-8026-c90afbdad2e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:08.716272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda993c-0b1a-467b-8026-c90afbdad2e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:08.719939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615246-5b0c-4212-bc6b-ba91d0d4084f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:08.720595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615246-5b0c-4212-bc6b-ba91d0d4084f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:08.720880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615246-5b0c-4212-bc6b-ba91d0d4084f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:08.721158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615246-5b0c-4212-bc6b-ba91d0d4084f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:08.730473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49615246-5b0c-4212-bc6b-ba91d0d4084f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:08.731922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49615246-5b0c-4212-bc6b-ba91d0d4084f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:08.741371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 726/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:11.148513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575069b8-bbb8-416a-9a20-5e78acd57034 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:11.149127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575069b8-bbb8-416a-9a20-5e78acd57034 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:11.149127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575069b8-bbb8-416a-9a20-5e78acd57034 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:11.150440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:11.155838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560054-b583-4b0e-bfde-57538c880d80 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:11.156308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560054-b583-4b0e-bfde-57538c880d80 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:11.156419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560054-b583-4b0e-bfde-57538c880d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:11.174158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-19560054-b583-4b0e-bfde-57538c880d80 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:11.175953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-19560054-b583-4b0e-bfde-57538c880d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:11.183948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:09:11.222145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575069b8-bbb8-416a-9a20-5e78acd57034 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:11.232949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575069b8-bbb8-416a-9a20-5e78acd57034 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:11.236454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d251666-a767-45dc-b532-47995c43ad94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:11.237087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d251666-a767-45dc-b532-47995c43ad94 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:11.237374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d251666-a767-45dc-b532-47995c43ad94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:11.237675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d251666-a767-45dc-b532-47995c43ad94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:11.247184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d251666-a767-45dc-b532-47995c43ad94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:11.248614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d251666-a767-45dc-b532-47995c43ad94 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:11.258760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 719/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:13.896502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288b06-68b7-4eb5-bdd4-f45cd0ccee30 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:13.897077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288b06-68b7-4eb5-bdd4-f45cd0ccee30 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:13.897077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288b06-68b7-4eb5-bdd4-f45cd0ccee30 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:13.898450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:13.904011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75baac2c-96c0-41d3-a0aa-0103bb7869e6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:13.904431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75baac2c-96c0-41d3-a0aa-0103bb7869e6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:13.904577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75baac2c-96c0-41d3-a0aa-0103bb7869e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:13.922302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-75baac2c-96c0-41d3-a0aa-0103bb7869e6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:13.923552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-75baac2c-96c0-41d3-a0aa-0103bb7869e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:13.931567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:13.971392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288b06-68b7-4eb5-bdd4-f45cd0ccee30 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:13.982268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288b06-68b7-4eb5-bdd4-f45cd0ccee30 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:13.985850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c803505-888f-4799-abd9-f35b7b100045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:13.992600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c803505-888f-4799-abd9-f35b7b100045 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:13.992600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c803505-888f-4799-abd9-f35b7b100045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:13.992600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c803505-888f-4799-abd9-f35b7b100045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:13.996463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c803505-888f-4799-abd9-f35b7b100045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:13.997892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c803505-888f-4799-abd9-f35b7b100045 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:14.008308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 729/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:16.393224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee58b-be2e-4409-8cb4-d4b16f5f1fd9 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:16.394373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee58b-be2e-4409-8cb4-d4b16f5f1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:16.394373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee58b-be2e-4409-8cb4-d4b16f5f1fd9 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:16.395957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:16.401251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e55b4-c620-4ba9-87e8-8286a1830a38 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:16.401644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e55b4-c620-4ba9-87e8-8286a1830a38 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:16.401807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e55b4-c620-4ba9-87e8-8286a1830a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:16.419091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ac0e55b4-c620-4ba9-87e8-8286a1830a38 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:16.420526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ac0e55b4-c620-4ba9-87e8-8286a1830a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:16.428902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:16.467964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcee58b-be2e-4409-8cb4-d4b16f5f1fd9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:16.478959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcee58b-be2e-4409-8cb4-d4b16f5f1fd9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:16.482470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3732c-8ad1-4349-9094-7f4e593ac52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:16.483130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3732c-8ad1-4349-9094-7f4e593ac52e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:16.483419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3732c-8ad1-4349-9094-7f4e593ac52e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:16.483698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3732c-8ad1-4349-9094-7f4e593ac52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:16.493441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3732c-8ad1-4349-9094-7f4e593ac52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:16.494868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3732c-8ad1-4349-9094-7f4e593ac52e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:16.505183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 722/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:18.881781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794e3a3-4105-4180-8ad2-f08db9f0c182 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:18.882359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794e3a3-4105-4180-8ad2-f08db9f0c182 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:18.882359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794e3a3-4105-4180-8ad2-f08db9f0c182 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:18.883718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:18.888915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388535d-3045-4403-b287-6b410b0f34db None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:18.889357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388535d-3045-4403-b287-6b410b0f34db None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:18.889481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388535d-3045-4403-b287-6b410b0f34db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:18.908525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0388535d-3045-4403-b287-6b410b0f34db None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:18.910578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0388535d-3045-4403-b287-6b410b0f34db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:18.918364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:18.955877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794e3a3-4105-4180-8ad2-f08db9f0c182 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:18.967198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794e3a3-4105-4180-8ad2-f08db9f0c182 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:18.970670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e703d-8fa6-41b3-a2cb-902ae101c583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:18.971335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e703d-8fa6-41b3-a2cb-902ae101c583 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:18.972303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e703d-8fa6-41b3-a2cb-902ae101c583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:18.972691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e703d-8fa6-41b3-a2cb-902ae101c583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:18.981596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e703d-8fa6-41b3-a2cb-902ae101c583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:18.983032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e703d-8fa6-41b3-a2cb-902ae101c583 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:18.992495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 732/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:21.367872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e90f7-aaca-43f6-8c90-be3dc3a9c3bb None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:21.368431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e90f7-aaca-43f6-8c90-be3dc3a9c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:21.368431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e90f7-aaca-43f6-8c90-be3dc3a9c3bb None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:21.369810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:21.375258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58285ca1-3ed5-4549-ad31-559483e3f491 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:21.375645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58285ca1-3ed5-4549-ad31-559483e3f491 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:21.375850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58285ca1-3ed5-4549-ad31-559483e3f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:21.394708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-58285ca1-3ed5-4549-ad31-559483e3f491 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:21.395934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-58285ca1-3ed5-4549-ad31-559483e3f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:21.403626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:21.442591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e90f7-aaca-43f6-8c90-be3dc3a9c3bb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:21.453006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e90f7-aaca-43f6-8c90-be3dc3a9c3bb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:21.457967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431128b-f8a7-41e5-a3c8-1caff8f72c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:21.458542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431128b-f8a7-41e5-a3c8-1caff8f72c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:21.458822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431128b-f8a7-41e5-a3c8-1caff8f72c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:21.459135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431128b-f8a7-41e5-a3c8-1caff8f72c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:21.468025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431128b-f8a7-41e5-a3c8-1caff8f72c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:21.469445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431128b-f8a7-41e5-a3c8-1caff8f72c13 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:21.478806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 725/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:23.819799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47330208-a729-47cd-bc97-07a7f763791e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:23.820374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47330208-a729-47cd-bc97-07a7f763791e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:23.820374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47330208-a729-47cd-bc97-07a7f763791e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:23.821702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:23.827083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab0aa-53cf-4046-8a09-457803acd85c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:23.827516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab0aa-53cf-4046-8a09-457803acd85c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:23.827633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab0aa-53cf-4046-8a09-457803acd85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:23.845658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2dbab0aa-53cf-4046-8a09-457803acd85c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:23.846857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2dbab0aa-53cf-4046-8a09-457803acd85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:23.854662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:23.892465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47330208-a729-47cd-bc97-07a7f763791e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:23.904176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47330208-a729-47cd-bc97-07a7f763791e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:23.907668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24559e1b-f768-477d-b03f-1044dcb95aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:23.908308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24559e1b-f768-477d-b03f-1044dcb95aee service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:23.908605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24559e1b-f768-477d-b03f-1044dcb95aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:23.909053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24559e1b-f768-477d-b03f-1044dcb95aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:23.918292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24559e1b-f768-477d-b03f-1044dcb95aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:23.920065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24559e1b-f768-477d-b03f-1044dcb95aee service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:23.930099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 735/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:26.239462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233d56-0daf-408b-9c38-cebf28417484 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:26.239976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233d56-0daf-408b-9c38-cebf28417484 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:26.240081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233d56-0daf-408b-9c38-cebf28417484 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:26.241369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:26.246596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10414e-33eb-4bb8-bd42-36f737e5d494 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:26.247032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10414e-33eb-4bb8-bd42-36f737e5d494 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:26.247188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10414e-33eb-4bb8-bd42-36f737e5d494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:26.264969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-db10414e-33eb-4bb8-bd42-36f737e5d494 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:26.266391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db10414e-33eb-4bb8-bd42-36f737e5d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:26.274680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:26.313303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2233d56-0daf-408b-9c38-cebf28417484 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:26.325635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2233d56-0daf-408b-9c38-cebf28417484 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:26.329533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22099e18-e8b6-4795-bc84-b017d0cc89c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:26.330183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22099e18-e8b6-4795-bc84-b017d0cc89c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:26.330505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22099e18-e8b6-4795-bc84-b017d0cc89c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:26.330786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22099e18-e8b6-4795-bc84-b017d0cc89c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:26.340437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22099e18-e8b6-4795-bc84-b017d0cc89c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:26.341860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22099e18-e8b6-4795-bc84-b017d0cc89c9 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:26.351446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 728/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:28.652667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefdb97-8980-49d6-ad15-c0cfb69059b5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:28.653205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefdb97-8980-49d6-ad15-c0cfb69059b5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:28.653205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefdb97-8980-49d6-ad15-c0cfb69059b5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:28.654559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:28.659929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976354c6-3c60-4047-a1f6-298e5087b02e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:28.660386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976354c6-3c60-4047-a1f6-298e5087b02e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:28.660494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976354c6-3c60-4047-a1f6-298e5087b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:28.678856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-976354c6-3c60-4047-a1f6-298e5087b02e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:28.680076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-976354c6-3c60-4047-a1f6-298e5087b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:28.687610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:28.723687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefdb97-8980-49d6-ad15-c0cfb69059b5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:28.733987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefdb97-8980-49d6-ad15-c0cfb69059b5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:28.737938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293233b-b435-45fd-a226-bcb73a633ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:28.738562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293233b-b435-45fd-a226-bcb73a633ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:28.738845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293233b-b435-45fd-a226-bcb73a633ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:28.739160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293233b-b435-45fd-a226-bcb73a633ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:28.748107 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293233b-b435-45fd-a226-bcb73a633ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:28.749472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293233b-b435-45fd-a226-bcb73a633ecb service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:28.759256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 738/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:09:31.104304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b0c1-5e4a-4986-a570-0831d8a2e520 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:31.104888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b0c1-5e4a-4986-a570-0831d8a2e520 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:31.104888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b0c1-5e4a-4986-a570-0831d8a2e520 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:31.106242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:09:31.112230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2721-1ca9-483b-994c-b1ea94b65098 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:31.112691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2721-1ca9-483b-994c-b1ea94b65098 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:31.113021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2721-1ca9-483b-994c-b1ea94b65098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:31.132420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e75c2721-1ca9-483b-994c-b1ea94b65098 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:09:31.133603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e75c2721-1ca9-483b-994c-b1ea94b65098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:09:31.141373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:09:31.180088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b0c1-5e4a-4986-a570-0831d8a2e520 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:09:31.191434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b0c1-5e4a-4986-a570-0831d8a2e520 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:09:31.194901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e3686-e3b2-474f-b628-a4e680afe71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:09:31.195561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e3686-e3b2-474f-b628-a4e680afe71b service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:09:31.195843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e3686-e3b2-474f-b628-a4e680afe71b service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:09:31.196116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e3686-e3b2-474f-b628-a4e680afe71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:09:31.206902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e3686-e3b2-474f-b628-a4e680afe71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:09:31.207885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e3686-e3b2-474f-b628-a4e680afe71b service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:09:31.217752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 731/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:10:05.932046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070c4b-0afb-4d1e-9d1f-588ed76680b2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:05.932670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070c4b-0afb-4d1e-9d1f-588ed76680b2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:05.932670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070c4b-0afb-4d1e-9d1f-588ed76680b2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:05.933959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 740/1471] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:05.939916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78189ce-58b1-40d0-83cd-ec44c861bda8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:05.949956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78189ce-58b1-40d0-83cd-ec44c861bda8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:05.949956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78189ce-58b1-40d0-83cd-ec44c861bda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:05.958250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a78189ce-58b1-40d0-83cd-ec44c861bda8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:05.959534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a78189ce-58b1-40d0-83cd-ec44c861bda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:05.967357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 732/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:06.014489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492359-de1a-4b58-ab07-6923bae86528 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:06.014788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492359-de1a-4b58-ab07-6923bae86528 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:06.015622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492359-de1a-4b58-ab07-6923bae86528 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:06.016981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 741/1473] 10.222.0.23 () {54 vars in 962 bytes} [Wed May 4 18:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:06.021923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123f49-4ddd-4706-a038-23847e2b225c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:06.022215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123f49-4ddd-4706-a038-23847e2b225c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:06.022492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123f49-4ddd-4706-a038-23847e2b225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:06.040976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-24123f49-4ddd-4706-a038-23847e2b225c None None] MFA Rules not processed for user `4c7559dd645048dd99a4b8a5d3537230`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:06.042512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-24123f49-4ddd-4706-a038-23847e2b225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:06.050081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 733/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Wed May 4 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:06.057593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492359-de1a-4b58-ab07-6923bae86528 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:06.069354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492359-de1a-4b58-ab07-6923bae86528 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:06.072965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c5a54-fada-42bd-a9dc-0936c01a80a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:06.073612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5a54-fada-42bd-a9dc-0936c01a80a2 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:06.073895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5a54-fada-42bd-a9dc-0936c01a80a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:06.074172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5a54-fada-42bd-a9dc-0936c01a80a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:06.083834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5a54-fada-42bd-a9dc-0936c01a80a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:06.085281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5a54-fada-42bd-a9dc-0936c01a80a2 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:06.095824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 742/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:10:08.465349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec2427-862e-4084-b6f0-a00bd1e2152e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:08.465900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec2427-862e-4084-b6f0-a00bd1e2152e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:08.465900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec2427-862e-4084-b6f0-a00bd1e2152e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:08.467361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 734/1476] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:08.472933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24267-590a-409e-bc7a-3ba24a2e0cf9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:08.473377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24267-590a-409e-bc7a-3ba24a2e0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:08.473493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24267-590a-409e-bc7a-3ba24a2e0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:08.491609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-daa24267-590a-409e-bc7a-3ba24a2e0cf9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:08.492836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-daa24267-590a-409e-bc7a-3ba24a2e0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:08.501083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 743/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:08.523870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec2427-862e-4084-b6f0-a00bd1e2152e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:08.536697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec2427-862e-4084-b6f0-a00bd1e2152e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:08.541119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:08.542015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:08.542322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:08.542616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:08.543377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:08.545125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:10:08.545125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:10:08.545125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:10:08.546885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcef30-1def-4a34-8252-e657c5e7d2cd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:08.565701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 735/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 18:10:08 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:10:10.886337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed40a-dc8f-421d-9be9-c60c7b9c54ca None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:10.886918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed40a-dc8f-421d-9be9-c60c7b9c54ca None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:10.886918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed40a-dc8f-421d-9be9-c60c7b9c54ca None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:10.888279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 744/1479] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:10.893593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99098662-8388-4998-9dd1-5a8cf63472be None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:10.894059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99098662-8388-4998-9dd1-5a8cf63472be None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:10.894215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99098662-8388-4998-9dd1-5a8cf63472be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:10.914019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-99098662-8388-4998-9dd1-5a8cf63472be None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:10.915264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-99098662-8388-4998-9dd1-5a8cf63472be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:10.924019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 736/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:10.968732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ed40a-dc8f-421d-9be9-c60c7b9c54ca None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:10.983976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ed40a-dc8f-421d-9be9-c60c7b9c54ca None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:10.989657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66010dd-6f7e-445a-aeaa-b0777e850fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:10.990299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66010dd-6f7e-445a-aeaa-b0777e850fa9 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:10.990585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66010dd-6f7e-445a-aeaa-b0777e850fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:10.990865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66010dd-6f7e-445a-aeaa-b0777e850fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:10.999279 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66010dd-6f7e-445a-aeaa-b0777e850fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:11.000978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66010dd-6f7e-445a-aeaa-b0777e850fa9 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:11.010457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 745/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:10:13.429830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f540c-d5cb-423a-b730-4f6c2f1cc270 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:13.430462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f540c-d5cb-423a-b730-4f6c2f1cc270 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:13.430462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f540c-d5cb-423a-b730-4f6c2f1cc270 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:13.431867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 737/1482] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:13.437534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582839ad-7008-4963-9419-aa88350081fe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:13.438017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582839ad-7008-4963-9419-aa88350081fe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:13.438129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582839ad-7008-4963-9419-aa88350081fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:13.456744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-582839ad-7008-4963-9419-aa88350081fe None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:13.457982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-582839ad-7008-4963-9419-aa88350081fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:13.465833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 746/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:13.501941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f540c-d5cb-423a-b730-4f6c2f1cc270 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:13.512338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f540c-d5cb-423a-b730-4f6c2f1cc270 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:13.516400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38abf3-02ce-4290-8008-a4a4a8d72e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:13.517024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38abf3-02ce-4290-8008-a4a4a8d72e5a service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:13.517307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38abf3-02ce-4290-8008-a4a4a8d72e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:13.517587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38abf3-02ce-4290-8008-a4a4a8d72e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:13.526167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38abf3-02ce-4290-8008-a4a4a8d72e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:13.527676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38abf3-02ce-4290-8008-a4a4a8d72e5a service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:13.537854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 738/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:10:15.858755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da809884-248a-49dd-85d8-e600bde44ba3 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:15.859380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da809884-248a-49dd-85d8-e600bde44ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:15.859380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da809884-248a-49dd-85d8-e600bde44ba3 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:15.860714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 747/1485] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:15.866029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55b4f5-fa81-4475-927a-ace4e4727f53 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:15.866476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55b4f5-fa81-4475-927a-ace4e4727f53 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:15.866573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55b4f5-fa81-4475-927a-ace4e4727f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:15.884223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cb55b4f5-fa81-4475-927a-ace4e4727f53 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:15.885421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cb55b4f5-fa81-4475-927a-ace4e4727f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:15.894297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 739/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:15.932157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da809884-248a-49dd-85d8-e600bde44ba3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:15.943437 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da809884-248a-49dd-85d8-e600bde44ba3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:15.947083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004a188-d87c-4f84-9c3d-c49101aecc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:15.947730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a188-d87c-4f84-9c3d-c49101aecc84 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:15.948010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a188-d87c-4f84-9c3d-c49101aecc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:15.948283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a188-d87c-4f84-9c3d-c49101aecc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:15.958602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a188-d87c-4f84-9c3d-c49101aecc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:15.960110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a188-d87c-4f84-9c3d-c49101aecc84 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:15.970485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 748/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:10:18.391561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c527bb4-774e-4876-8e8a-bccf710d598f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:18.392169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c527bb4-774e-4876-8e8a-bccf710d598f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:18.392169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c527bb4-774e-4876-8e8a-bccf710d598f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:18.393542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 740/1488] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:18.398619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61071f-a94e-4e2a-9aa6-c6cd0f8966d4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:18.399081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61071f-a94e-4e2a-9aa6-c6cd0f8966d4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:18.399215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61071f-a94e-4e2a-9aa6-c6cd0f8966d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:18.416917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ab61071f-a94e-4e2a-9aa6-c6cd0f8966d4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:18.418108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ab61071f-a94e-4e2a-9aa6-c6cd0f8966d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:18.426134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 749/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:10:18.468023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c527bb4-774e-4876-8e8a-bccf710d598f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:18.478497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c527bb4-774e-4876-8e8a-bccf710d598f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:18.482017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f6302-19e1-4bb5-b1f9-a4cf3fc40281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:18.483216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6302-19e1-4bb5-b1f9-a4cf3fc40281 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:18.483514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6302-19e1-4bb5-b1f9-a4cf3fc40281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:18.483802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6302-19e1-4bb5-b1f9-a4cf3fc40281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:18.492828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f6302-19e1-4bb5-b1f9-a4cf3fc40281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:18.494253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f6302-19e1-4bb5-b1f9-a4cf3fc40281 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:18.504953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 741/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:10:21.279306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701deb83-03a5-46b7-8a45-995ce2b571cc None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:21.279866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701deb83-03a5-46b7-8a45-995ce2b571cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:21.279978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701deb83-03a5-46b7-8a45-995ce2b571cc None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:21.281343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 750/1491] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 18:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:10:21.286876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc56d2-ef64-4565-8ada-5d6b6b58605d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:21.287324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc56d2-ef64-4565-8ada-5d6b6b58605d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:21.287471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc56d2-ef64-4565-8ada-5d6b6b58605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:21.304959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b9bc56d2-ef64-4565-8ada-5d6b6b58605d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:10:21.306155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b9bc56d2-ef64-4565-8ada-5d6b6b58605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:10:21.314488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 742/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:10:21.355541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701deb83-03a5-46b7-8a45-995ce2b571cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:10:21.366975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701deb83-03a5-46b7-8a45-995ce2b571cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:10:21.370537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79a471-2089-4f4e-9e52-c9d42253786b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:10:21.371211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79a471-2089-4f4e-9e52-c9d42253786b service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:10:21.371500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79a471-2089-4f4e-9e52-c9d42253786b service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:10:21.371780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79a471-2089-4f4e-9e52-c9d42253786b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:10:21.381604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79a471-2089-4f4e-9e52-c9d42253786b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:10:21.383059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79a471-2089-4f4e-9e52-c9d42253786b service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:10:21.393575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 751/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:12:06.042230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.042832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.042832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.060972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:12:06.062168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:12:06.069906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 743/1494] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:12:06.077858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.078348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.078448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.096082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:12:06.097267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:12:06.105595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 752/1495] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:12:06.110204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.120487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18077046-0c5a-49f4-afed-2f27d415ee10 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.125048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.125691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.125975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.126253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.126974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:12:06.127305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.128303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:06.128303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:12:06.128303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:12:06.129189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.140981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 744/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:12:06.149748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.159172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5a330-5512-4e16-ab0f-cd863b2414e9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.163760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.164404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.164726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.165734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.166428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.168203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:06.168203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:12:06.168203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:12:06.169406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.327637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 753/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:12:06 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:12:06.331815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.342244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abef29-1619-4a8b-a015-5c3c437c8c44 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.395795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.396404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.396684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.396948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.397649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.398648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:06.398648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:12:06.398648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:12:06.400483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.483878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 745/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:12:06 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:12:06.488000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.498009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4e0f-0eb5-419b-a9c8-5e1cebb70130 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.502513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.503186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.503473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.503745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.504458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.505474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:06.505474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:12:06.505474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:12:06.506343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.520780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 754/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:12:06.525484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.535712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4d59-592c-4fd5-bf56-6f016f45d6c0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.541061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.541724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.542011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.542292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.543044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.544051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:06.544051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:12:06.544051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:12:06.544931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6f9d9-fdd9-4be3-a4ba-af8d67433910 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.558246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 746/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:12:06.562325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.572785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b609f2-05de-4934-9385-d731188d8013 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.577255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.578172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.578402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.578674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] PATH_INFO: `/v3/projects/44f4c9dde58646e2a20018e9a622d22c/users/179196a339d64c548b69e838e3378eb2/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.593263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f4c9dde58646e2a20018e9a622d22c, user_id=179196a339d64c548b69e838e3378eb2, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.594292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:06.594292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:12:06.594292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:12:06.596257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.698200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 755/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:12:06 2022] PUT /identity/v3/projects/44f4c9dde58646e2a20018e9a622d22c/users/179196a339d64c548b69e838e3378eb2/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:12:06.709577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5678-0596-4c44-82ea-18e55ae9faad None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.709922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5678-0596-4c44-82ea-18e55ae9faad None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.710205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5678-0596-4c44-82ea-18e55ae9faad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.737694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f58a5678-0596-4c44-82ea-18e55ae9faad None None] MFA Rules not processed for user `179196a339d64c548b69e838e3378eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:12:06.738915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f58a5678-0596-4c44-82ea-18e55ae9faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:12:06.800079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 747/1502] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:12:06.811771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:06.881261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f21f-006c-45a4-ad68-2ed7daa593b7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:06.887636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:06.888291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.888576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.888851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.896627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:06.898225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:06.907460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 756/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:12:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:12:06.978722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ee59-2c91-4325-a120-b94f00e5b645 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:06.979043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ee59-2c91-4325-a120-b94f00e5b645 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:06.979354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ee59-2c91-4325-a120-b94f00e5b645 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:06.980656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 748/1504] 10.222.0.23 () {52 vars in 829 bytes} [Wed May 4 18:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:12:06.984255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:07.046111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62465d-c4e7-4dda-8870-e6d079e02584 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:07.050522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:07.051408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:07.051689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:07.051961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] PATH_INFO: `/v3/users/179196a339d64c548b69e838e3378eb2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:07.053110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179196a339d64c548b69e838e3378eb2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:07.054121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:07.054121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:12:07.054121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:12:07.055948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:07.299367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179196a339d64c548b69e838e3378eb2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:07.317575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179196a339d64c548b69e838e3378eb2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:07.318240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179196a339d64c548b69e838e3378eb2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:07.319015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179196a339d64c548b69e838e3378eb2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:07.382795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179196a339d64c548b69e838e3378eb2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:07.400872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 757/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:12:06 2022] DELETE /identity/v3/users/179196a339d64c548b69e838e3378eb2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:12:07.405318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:07.405831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:07.405962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:07.424410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:12:07.425608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:12:07.483522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 749/1506] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:12:07.493758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:07.495248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:12:07.551191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f0f49-9a5e-4c5a-92a1-8555ad8dd3d8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:07.554763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02227-1da3-4f5b-a5b0-74f0744262c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:07.556072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02227-1da3-4f5b-a5b0-74f0744262c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:07.556357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02227-1da3-4f5b-a5b0-74f0744262c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:07.556737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02227-1da3-4f5b-a5b0-74f0744262c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:07.565532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f02227-1da3-4f5b-a5b0-74f0744262c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:07.566973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f02227-1da3-4f5b-a5b0-74f0744262c1 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:07.576347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 758/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:12:08.065148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:12:08.066546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:12:08.080568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5ad0c-6eec-46b6-82bc-6a82d2e63804 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:12:08.085734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:12:08.087237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:12:08.087524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:12:08.087805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] PATH_INFO: `/v3/projects/44f4c9dde58646e2a20018e9a622d22c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:12:08.089134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f4c9dde58646e2a20018e9a622d22c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:12:08.090342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:12:08.090342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:12:08.090342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:12:08.091580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:12:08.199211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f4c9dde58646e2a20018e9a622d22c', 'request_id': 'req-04e09486-95b7-492c-a7c5-254b3876442f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:08.274750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f4c9dde58646e2a20018e9a622d22c', 'request_id': 'req-04e09486-95b7-492c-a7c5-254b3876442f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:08.281401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f4c9dde58646e2a20018e9a622d22c', 'request_id': 'req-04e09486-95b7-492c-a7c5-254b3876442f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:08.300291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] The token cache is being invalidate because project 44f4c9dde58646e2a20018e9a622d22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:12:08.300577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:08.301325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-04e09486-95b7-492c-a7c5-254b3876442f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:12:08.303049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 750/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:12:08 2022] DELETE /identity/v3/projects/44f4c9dde58646e2a20018e9a622d22c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:13:46.296457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0190-59b9-4002-a45d-9269a48b73d0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:46.297045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0190-59b9-4002-a45d-9269a48b73d0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:46.297146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0190-59b9-4002-a45d-9269a48b73d0 None None] PATH_INFO: `/v3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:46.298453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 759/1509] 10.222.0.84 () {54 vars in 925 bytes} [Wed May 4 18:13:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:13:46.305288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627a64-f591-4f09-9b58-d23c00dfff01 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:46.305745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627a64-f591-4f09-9b58-d23c00dfff01 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:46.305850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627a64-f591-4f09-9b58-d23c00dfff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:46.323950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c3627a64-f591-4f09-9b58-d23c00dfff01 None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:13:46.325229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c3627a64-f591-4f09-9b58-d23c00dfff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:13:46.387220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 751/1510] 10.222.0.84 () {58 vars in 1015 bytes} [Wed May 4 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:13:48.546061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ce16-ada5-4fa3-b24e-68fb046aebe9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:48.546648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ce16-ada5-4fa3-b24e-68fb046aebe9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:48.546648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ce16-ada5-4fa3-b24e-68fb046aebe9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:48.548005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:13:48.553373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65427d3f-6922-424e-a924-6e66472a7a05 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:48.553807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65427d3f-6922-424e-a924-6e66472a7a05 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:48.553911 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65427d3f-6922-424e-a924-6e66472a7a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:48.572211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-65427d3f-6922-424e-a924-6e66472a7a05 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:13:48.573410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-65427d3f-6922-424e-a924-6e66472a7a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:13:48.630573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:13:48.781001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ce16-ada5-4fa3-b24e-68fb046aebe9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:13:48.782691 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9b55ce16-ada5-4fa3-b24e-68fb046aebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:13:48.856071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ce16-ada5-4fa3-b24e-68fb046aebe9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:13:48.861284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c31c-a6a9-413a-b7b9-f07ac33e61d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:13:48.861921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c31c-a6a9-413a-b7b9-f07ac33e61d0 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:48.862203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c31c-a6a9-413a-b7b9-f07ac33e61d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:48.862477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c31c-a6a9-413a-b7b9-f07ac33e61d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:48.871742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c31c-a6a9-413a-b7b9-f07ac33e61d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:13:48.873316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c31c-a6a9-413a-b7b9-f07ac33e61d0 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:13:48.882568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 761/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:13:50.109056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2c7d-1621-4193-9bc4-d172ec6df77a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:50.109599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2c7d-1621-4193-9bc4-d172ec6df77a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:50.109599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2c7d-1621-4193-9bc4-d172ec6df77a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:50.111100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:13:50.116167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec277ba-c30f-4235-962d-78856703ada5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:50.116584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec277ba-c30f-4235-962d-78856703ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:50.116732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec277ba-c30f-4235-962d-78856703ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:50.134315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1ec277ba-c30f-4235-962d-78856703ada5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:13:50.135634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1ec277ba-c30f-4235-962d-78856703ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:13:50.143249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:13:50.295075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2c7d-1621-4193-9bc4-d172ec6df77a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:13:50.310044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2c7d-1621-4193-9bc4-d172ec6df77a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:13:50.315448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e35d-85da-472b-837e-2e9eb8abd998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:13:50.316115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e35d-85da-472b-837e-2e9eb8abd998 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:50.316403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e35d-85da-472b-837e-2e9eb8abd998 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:50.316683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e35d-85da-472b-837e-2e9eb8abd998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:50.325996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90e35d-85da-472b-837e-2e9eb8abd998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:13:50.327723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90e35d-85da-472b-837e-2e9eb8abd998 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:13:50.337832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 754/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:13:53.756052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b501-c426-4375-8c9d-f9f203651fce None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:53.756625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b501-c426-4375-8c9d-f9f203651fce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:53.756625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b501-c426-4375-8c9d-f9f203651fce None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:53.757959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 763/1517] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 18:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:13:53.763151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e731-4a56-4440-9ae1-1821778e8bf7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:53.763600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e731-4a56-4440-9ae1-1821778e8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:53.763849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e731-4a56-4440-9ae1-1821778e8bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:53.782468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-af89e731-4a56-4440-9ae1-1821778e8bf7 None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:13:53.783780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-af89e731-4a56-4440-9ae1-1821778e8bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:13:53.792821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 755/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:13:53.800300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b501-c426-4375-8c9d-f9f203651fce None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:13:53.820045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b501-c426-4375-8c9d-f9f203651fce None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:13:53.825005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b0436-adcb-4588-b253-8c5c765dbb36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:13:53.825650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0436-adcb-4588-b253-8c5c765dbb36 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:13:53.825935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0436-adcb-4588-b253-8c5c765dbb36 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:13:53.826343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0436-adcb-4588-b253-8c5c765dbb36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:13:53.835677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b0436-adcb-4588-b253-8c5c765dbb36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:13:53.837263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b0436-adcb-4588-b253-8c5c765dbb36 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:13:53.846791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 764/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:14:02.013365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ae9a9-d727-4041-852c-a10c454c1af4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:02.013951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ae9a9-d727-4041-852c-a10c454c1af4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:02.013951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ae9a9-d727-4041-852c-a10c454c1af4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:02.015332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 756/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:02.020254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7064c-caeb-473e-8479-2f4a47fb0eda None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:02.020663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7064c-caeb-473e-8479-2f4a47fb0eda None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:02.020819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7064c-caeb-473e-8479-2f4a47fb0eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:02.041398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-01e7064c-caeb-473e-8479-2f4a47fb0eda None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:02.042624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-01e7064c-caeb-473e-8479-2f4a47fb0eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:02.050484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 765/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:02.202650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ae9a9-d727-4041-852c-a10c454c1af4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:14:02.217181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ae9a9-d727-4041-852c-a10c454c1af4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:14:02.222589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2a3c7-f457-4d4e-80a2-b07a38217f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:14:02.223283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2a3c7-f457-4d4e-80a2-b07a38217f85 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:02.223573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2a3c7-f457-4d4e-80a2-b07a38217f85 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:02.223849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2a3c7-f457-4d4e-80a2-b07a38217f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:02.231898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2a3c7-f457-4d4e-80a2-b07a38217f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:14:02.233495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2a3c7-f457-4d4e-80a2-b07a38217f85 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:14:02.243798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 757/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:14:03.456223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d0ac2-982e-448a-8275-3caddf4e5f33 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:03.456765 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d0ac2-982e-448a-8275-3caddf4e5f33 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:03.456765 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d0ac2-982e-448a-8275-3caddf4e5f33 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:03.458007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 766/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:03.463547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cda2f-e6c2-4feb-88e5-62b103c56bae None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:03.464005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cda2f-e6c2-4feb-88e5-62b103c56bae None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:03.464116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cda2f-e6c2-4feb-88e5-62b103c56bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:03.484081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-870cda2f-e6c2-4feb-88e5-62b103c56bae None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:03.485278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-870cda2f-e6c2-4feb-88e5-62b103c56bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:03.493441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 758/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:03.645639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d0ac2-982e-448a-8275-3caddf4e5f33 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:14:03.659936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d0ac2-982e-448a-8275-3caddf4e5f33 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:14:03.665417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e77e9b-c89a-4dbb-8c7f-cf6bbb36df6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:14:03.666055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e77e9b-c89a-4dbb-8c7f-cf6bbb36df6e service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:03.666340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e77e9b-c89a-4dbb-8c7f-cf6bbb36df6e service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:03.666620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e77e9b-c89a-4dbb-8c7f-cf6bbb36df6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:03.674557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e77e9b-c89a-4dbb-8c7f-cf6bbb36df6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:14:03.676165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e77e9b-c89a-4dbb-8c7f-cf6bbb36df6e service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:14:03.685900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 767/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:14:07.987533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdc71-502e-4a3b-b31a-8fd94087b69a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:07.988100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdc71-502e-4a3b-b31a-8fd94087b69a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:07.988100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdc71-502e-4a3b-b31a-8fd94087b69a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:07.989632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 759/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:07.994918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe529c-0401-48c1-b06b-d91a81d22c65 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:07.997142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe529c-0401-48c1-b06b-d91a81d22c65 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:07.997142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe529c-0401-48c1-b06b-d91a81d22c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:08.013185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-83fe529c-0401-48c1-b06b-d91a81d22c65 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:08.014377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-83fe529c-0401-48c1-b06b-d91a81d22c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:08.022772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 768/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:08.059418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cdc71-502e-4a3b-b31a-8fd94087b69a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:14:08.061228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e14cdc71-502e-4a3b-b31a-8fd94087b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:08.118220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cdc71-502e-4a3b-b31a-8fd94087b69a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:14:08.121779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182aaeb-7c7b-4d49-95fd-ee0688ac38f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:14:08.122424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182aaeb-7c7b-4d49-95fd-ee0688ac38f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:08.122709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182aaeb-7c7b-4d49-95fd-ee0688ac38f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:08.123001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182aaeb-7c7b-4d49-95fd-ee0688ac38f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:08.131779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182aaeb-7c7b-4d49-95fd-ee0688ac38f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:14:08.133206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182aaeb-7c7b-4d49-95fd-ee0688ac38f4 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:14:08.142314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 760/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:14:10.362261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef13a8c-6501-4fe6-9bc3-b74286ec60a6 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:10.362833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef13a8c-6501-4fe6-9bc3-b74286ec60a6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:10.362833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef13a8c-6501-4fe6-9bc3-b74286ec60a6 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:10.364821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 769/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:10.370414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a7aaf-e0fd-40d4-be48-70ad0170ff1e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:10.370831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a7aaf-e0fd-40d4-be48-70ad0170ff1e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:10.371002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a7aaf-e0fd-40d4-be48-70ad0170ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:10.389341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-362a7aaf-e0fd-40d4-be48-70ad0170ff1e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:10.390537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-362a7aaf-e0fd-40d4-be48-70ad0170ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:10.398612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 761/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:10.435192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef13a8c-6501-4fe6-9bc3-b74286ec60a6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:14:10.436879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eef13a8c-6501-4fe6-9bc3-b74286ec60a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:10.450084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef13a8c-6501-4fe6-9bc3-b74286ec60a6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:14:10.453547 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214466-20f1-478d-9479-ad310f541c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:14:10.454178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214466-20f1-478d-9479-ad310f541c9f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:10.454458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214466-20f1-478d-9479-ad310f541c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:10.454733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214466-20f1-478d-9479-ad310f541c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:10.463955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214466-20f1-478d-9479-ad310f541c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:14:10.465310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214466-20f1-478d-9479-ad310f541c9f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:14:10.474755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 770/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:14:14.365406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389718a-4e91-4733-a43f-5893d2ae27bf None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:14.365984 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389718a-4e91-4733-a43f-5893d2ae27bf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:14.365984 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389718a-4e91-4733-a43f-5893d2ae27bf None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:14.367370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 762/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:14.372565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123929-53a7-4e0b-bf16-15eeddc24c51 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:14.372972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123929-53a7-4e0b-bf16-15eeddc24c51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:14.373119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123929-53a7-4e0b-bf16-15eeddc24c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:14.392005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bc123929-53a7-4e0b-bf16-15eeddc24c51 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:14.393199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bc123929-53a7-4e0b-bf16-15eeddc24c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:14.401950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 771/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:14.678744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389718a-4e91-4733-a43f-5893d2ae27bf None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:14:14.680448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5389718a-4e91-4733-a43f-5893d2ae27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:14.736098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389718a-4e91-4733-a43f-5893d2ae27bf None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:14:14.740493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a652d-9a3a-4f0c-96f3-c54ba0dd80b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:14:14.741135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a652d-9a3a-4f0c-96f3-c54ba0dd80b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:14.741423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a652d-9a3a-4f0c-96f3-c54ba0dd80b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:14.741708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a652d-9a3a-4f0c-96f3-c54ba0dd80b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:14.750485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a652d-9a3a-4f0c-96f3-c54ba0dd80b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:14:14.751978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a652d-9a3a-4f0c-96f3-c54ba0dd80b5 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:14:14.762522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 763/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:14:17.159492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05343e88-0fd7-4274-8270-7d3e65047946 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:17.160087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05343e88-0fd7-4274-8270-7d3e65047946 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:17.160087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05343e88-0fd7-4274-8270-7d3e65047946 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:17.161700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 772/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:17.166843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e9b8c-cbe7-43be-9a50-84bf5b1b9b9f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:17.167300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e9b8c-cbe7-43be-9a50-84bf5b1b9b9f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:17.167425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e9b8c-cbe7-43be-9a50-84bf5b1b9b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:17.185492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f10e9b8c-cbe7-43be-9a50-84bf5b1b9b9f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:17.186663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f10e9b8c-cbe7-43be-9a50-84bf5b1b9b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:17.195140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 764/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:17.480477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0160dc-f8b9-42e9-be2b-83e979fa03e4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:17.480757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0160dc-f8b9-42e9-be2b-83e979fa03e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:17.481069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0160dc-f8b9-42e9-be2b-83e979fa03e4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:17.482427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 773/1537] 10.222.0.23 () {54 vars in 963 bytes} [Wed May 4 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:14:17.487311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1d97e-2be4-48a8-a2b4-fe7983e3ae67 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:17.487603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1d97e-2be4-48a8-a2b4-fe7983e3ae67 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:17.487886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1d97e-2be4-48a8-a2b4-fe7983e3ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:17.506603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e2d1d97e-2be4-48a8-a2b4-fe7983e3ae67 None None] MFA Rules not processed for user `e7ee1066de2a40f988f50b9b48a0ac5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:14:17.507809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e2d1d97e-2be4-48a8-a2b4-fe7983e3ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:14:17.514223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 765/1538] 10.222.0.23 () {58 vars in 1060 bytes} [Wed May 4 18:14:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:14:17.522135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0160dc-f8b9-42e9-be2b-83e979fa03e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:14:17.532899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0160dc-f8b9-42e9-be2b-83e979fa03e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:14:17.536904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7fb7-3a44-4658-8463-0b8cacf4de39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:14:17.537533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7fb7-3a44-4658-8463-0b8cacf4de39 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:14:17.537816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7fb7-3a44-4658-8463-0b8cacf4de39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:14:17.538091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7fb7-3a44-4658-8463-0b8cacf4de39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:14:17.546670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7fb7-3a44-4658-8463-0b8cacf4de39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:14:17.548125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7fb7-3a44-4658-8463-0b8cacf4de39 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:14:17.557913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 774/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:47.259045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.260120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.260618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.293482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.295212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.310062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 766/1540] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.320824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097565-f027-4183-8b3e-724415186d79 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.321413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097565-f027-4183-8b3e-724415186d79 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.321413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097565-f027-4183-8b3e-724415186d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.347999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-94097565-f027-4183-8b3e-724415186d79 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.356226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-94097565-f027-4183-8b3e-724415186d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.370458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 775/1541] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.375029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:47.385169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e588f77-471c-439d-989f-2a3bcd45ceda None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:47.395833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:47.396895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.397397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.397883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.398834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:47.400001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:47.401861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d5375-e0e5-46c4-8fe9-c0c6409a5c30 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:47.415855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 767/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:47.424639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097565-f027-4183-8b3e-724415186d79 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:47.435528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097565-f027-4183-8b3e-724415186d79 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:47.447248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:47.448174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.448464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.448794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.449842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:47.452094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:47.476821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f7675-1223-4972-9c59-94997d7a5d93 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.477424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f7675-1223-4972-9c59-94997d7a5d93 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.477910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f7675-1223-4972-9c59-94997d7a5d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.511012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-047f7675-1223-4972-9c59-94997d7a5d93 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.512821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-047f7675-1223-4972-9c59-94997d7a5d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.525525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 768/1543] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:15:47.536283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.536880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.537357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.560624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.562196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.575489 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 769/1544] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:15:47.580778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:47.582351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 776/1545] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:47.586014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:47.594146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3ef7c-efc5-4948-bfe0-cc0c63c57a72 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:47.674534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:47.675282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.675570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.675852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.676634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:47.680838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:47.683825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566f6e-17fa-476d-815b-fc4e25d8ea55 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:47.715411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 770/1546] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:15:47.718020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5873cd-efa7-4405-aa00-588b5abba3d7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:47.725263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30aef-82fe-4350-bb18-4f209cbe30bb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.725892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30aef-82fe-4350-bb18-4f209cbe30bb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.726340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30aef-82fe-4350-bb18-4f209cbe30bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.741851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:47.742815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.743305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.744152 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.745036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:47.746267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:15:47.746267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:15:47.746267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:15:47.750096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451844a-42b9-4245-9dce-c47d52ddaee2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:47.760721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d8f30aef-82fe-4350-bb18-4f209cbe30bb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.762249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d8f30aef-82fe-4350-bb18-4f209cbe30bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.781750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 771/1547] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.783734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.784678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.785167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.806586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.807828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.821879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 772/1548] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.823229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:47.833996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7944ca2-4228-4cc5-bdd3-393e530243e4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:47.838712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:47.839402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.839686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.839963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.840654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:47.841681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:15:47.841681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:15:47.841681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:15:47.843211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e4c3-29a9-4635-8e57-83df3d6dbff4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:47.855884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 777/1549] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:15:47.860333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab985-092f-4ac0-9231-03bae9abc774 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.862766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab985-092f-4ac0-9231-03bae9abc774 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.862766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab985-092f-4ac0-9231-03bae9abc774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.879750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a47ab985-092f-4ac0-9231-03bae9abc774 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.880949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a47ab985-092f-4ac0-9231-03bae9abc774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.888863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 778/1550] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.890789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2484-951a-4bbc-a394-96ea6ce21343 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.891275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2484-951a-4bbc-a394-96ea6ce21343 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.897174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2484-951a-4bbc-a394-96ea6ce21343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.910683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-58da2484-951a-4bbc-a394-96ea6ce21343 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.911912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-58da2484-951a-4bbc-a394-96ea6ce21343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.919950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 779/1551] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.921940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ebf9-a701-4fb7-b552-3ea84e92f456 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.925007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ebf9-a701-4fb7-b552-3ea84e92f456 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.925007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ebf9-a701-4fb7-b552-3ea84e92f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.939750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4699ebf9-a701-4fb7-b552-3ea84e92f456 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.940914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4699ebf9-a701-4fb7-b552-3ea84e92f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.947931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 773/1552] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:47.948857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.948857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.948857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.950058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 780/1553] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:47.956600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462819-eccc-4222-9137-08912927ca28 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:47.956888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462819-eccc-4222-9137-08912927ca28 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:47.957178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462819-eccc-4222-9137-08912927ca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:47.971649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.972971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:47.977364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2a462819-eccc-4222-9137-08912927ca28 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:47.978525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2a462819-eccc-4222-9137-08912927ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:48.034293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 774/1554] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.035238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.041242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 781/1555] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.042628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.043116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.043334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.048557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cc8f7-5085-41f1-aadc-f37d60241020 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.053245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbae685-2c9b-4224-baab-741a883251fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.054004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbae685-2c9b-4224-baab-741a883251fc admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.054286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbae685-2c9b-4224-baab-741a883251fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.054563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbae685-2c9b-4224-baab-741a883251fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.055345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbae685-2c9b-4224-baab-741a883251fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.056928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbae685-2c9b-4224-baab-741a883251fc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.061337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:48.062571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:48.067497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 775/1556] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:48.068767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.080712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.080712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.080944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 782/1557] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.080944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.082006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b93dbc-7cd6-43b0-8ef6-fba091b6cb5f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.086639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.087329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.087613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.087893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.088621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:48.088931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.089993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:15:48.089993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:15:48.089993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:15:48.090891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1618da4-0869-4bc6-8238-b5de2d25c615 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.091264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:48.092465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:48.101250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 776/1558] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.103182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.112168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 783/1559] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:48.112168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69786b65-c94d-40da-8e5b-de310a3965ca None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.112168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69786b65-c94d-40da-8e5b-de310a3965ca None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.112168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69786b65-c94d-40da-8e5b-de310a3965ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.112657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62a030-8c1f-4978-a4b9-b89f04de57bc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.117625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535457d-958b-4daf-af5a-2af85080a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.118474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535457d-958b-4daf-af5a-2af85080a801 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.118761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535457d-958b-4daf-af5a-2af85080a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.119081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535457d-958b-4daf-af5a-2af85080a801 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.119770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535457d-958b-4daf-af5a-2af85080a801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.121776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535457d-958b-4daf-af5a-2af85080a801 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.127811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-69786b65-c94d-40da-8e5b-de310a3965ca None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:48.129033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-69786b65-c94d-40da-8e5b-de310a3965ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:48.137039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 784/1560] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.138265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.138557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.138838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.158969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:48.160170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:48.168081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 785/1561] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.168842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.177789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5f877-8a59-4f76-997b-0bf1b439150c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.182395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.185443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.185443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.185443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.185443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:48.185443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.186139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.205648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 786/1562] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:48.205648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.209311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eac309-ad35-43ea-926f-6d3720ff12c6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.214109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.214619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.214904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.215212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.215937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.217760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.234222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 787/1563] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:48.234222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.240035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 777/1564] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.240035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.240035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.240035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.249028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391322e3-7e81-4c8e-94ae-5e195d2d8470 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.254204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.254438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:48.254874 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.255198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.255477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.255746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:48.256212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:48.256522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.258126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.263805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 778/1565] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:48.264452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.278885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 788/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:48.278885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.279228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a0c26-9865-4136-ac23-5292b31e6c76 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.279228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.279869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.280147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.280423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.281838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.283760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.285922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f00b-be10-431f-8071-ee5c3c11cb1f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.290573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.291261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.291548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.291831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.292557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:48.292871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.294498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.306655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 789/1567] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:48.307505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.318059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee12a-e3cf-4b94-afc5-f6ac17b447a4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.322792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.323564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.323737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.324013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.324816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:48.325123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.326704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.339211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 790/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:48.341676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.349422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b5fa-6933-4101-b2fe-82d60b03beed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.354240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.354874 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.355185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.355465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.356243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.358132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.370850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 779/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.371929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.432497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a817-2070-4e04-9b6b-83546a096741 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.437960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.438848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.439159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.439435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] PATH_INFO: `/v3/projects/1437e10b84d943a885db1ec25dccc6e5/users/ba28b51976a54c89ac3beb5394b1ec76/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.449138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 791/1570] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.449138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.455572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1437e10b84d943a885db1ec25dccc6e5, user_id=ba28b51976a54c89ac3beb5394b1ec76, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.456619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:15:48.456619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:15:48.456619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:15:48.458804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.510746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823af5f-4034-4f9f-b812-8efb295c54c9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.516583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.517520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.517806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.518087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.518829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.520487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.530828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 792/1571] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:48.532002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.537713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 780/1572] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:48 2022] PUT /identity/v3/projects/1437e10b84d943a885db1ec25dccc6e5/users/ba28b51976a54c89ac3beb5394b1ec76/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:48.538837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.543043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998e46-b0e6-4670-a70d-b2b847d77b93 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.605530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.606205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.606487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.606764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.607541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:15:48.607858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.609462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.610588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02597d68-24d5-4d6f-b200-140dfa1662bd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.615548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.616259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.616545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.616823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.617523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.619578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.622676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 793/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:15:48.622676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.631658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386adf-39ae-4196-8180-0446344472e0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.636803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.637528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.637876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.638243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.639054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.641929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.714325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 781/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.715279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.743904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 794/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.743904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.777562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6dea-4630-4503-acfd-570ad6268a3b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.808860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef3c88-6b05-4e5b-b4c2-23bfaf548da4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.813961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.814777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.815099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.815382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.816135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.818080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.831626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.833161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.833161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.833161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.833489 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.835429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.881987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 795/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.881987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.891627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a181b64-3089-40af-befc-7cd39558ffa5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.896693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.897179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 782/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.897337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.897629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.898027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.898134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:48.898749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.900748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.962159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b75a-b711-47c3-a7a3-1b6fe05c6dc8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:48.966914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a74e02-9c6a-4225-862c-9692d75df6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:48.967609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a74e02-9c6a-4225-862c-9692d75df6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.967896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a74e02-9c6a-4225-862c-9692d75df6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.968383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a74e02-9c6a-4225-862c-9692d75df6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.969455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a74e02-9c6a-4225-862c-9692d75df6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:48.971112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a74e02-9c6a-4225-862c-9692d75df6c5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:48.980856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 783/1578] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:48.982119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:48.982431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:48.982802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:48.997917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 796/1579] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:48.997917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.002179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:49.003130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:49.008890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d8912-d4e4-4836-aef6-1cf9417c84ce admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.010785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 784/1580] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:49.011609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.015111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.015661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.015945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.016329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.017516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.019713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.022352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf911c5f-782c-4bb4-88d2-76522c1b51c1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.027254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.027923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.028210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.028488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.029173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.032302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.129324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 797/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:48 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:49.130144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.153856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 785/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:49 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:49.153856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.162540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b4bfe-4610-4d4f-8bd2-4dbe1f78a2e6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.196486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896581ef-ad21-4ba6-87e6-516ab50f4e7a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.208000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.208682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.208965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.209243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.210122 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.212209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.223533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.224212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.224501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.224781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.225518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.227147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.238502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 786/1583] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.239323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.251314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8732bb-62eb-4db8-9e38-63b56e454be9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.257738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.262564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.262564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.262564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.262564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.262564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.289114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 798/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:49 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:49.289924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.300581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50049645-d766-4dc2-b479-3426d0c9b4d6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.305672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.306538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.306826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.307151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] PATH_INFO: `/v3/projects/ec59e7ddf8164929b710290eddb43b83/users/ff8c7140be0d4fe898fc7c5d0916c6e9/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.321784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec59e7ddf8164929b710290eddb43b83, user_id=ff8c7140be0d4fe898fc7c5d0916c6e9, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.324481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.364125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 787/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:49 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:49.364962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.374129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5d836-26fd-4ee5-a088-b3cb569506df admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.378676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.379390 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.379629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.379910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.380622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.382198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.390829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 799/1586] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:49 2022] PUT /identity/v3/projects/ec59e7ddf8164929b710290eddb43b83/users/ff8c7140be0d4fe898fc7c5d0916c6e9/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:49.392275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.397693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 788/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.398752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.409681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3bc9-ed70-4efa-9609-51c1322bb6e7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.446573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd882-9c9e-426d-91f8-d5f75f8d4eb6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.450449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.451156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.451594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.451901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.463849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.464517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.464796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.465074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.465887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.467736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.512988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.514424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.525131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 800/1588] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:49.526295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.535771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590591-d15a-40a3-9dbe-2884e3599612 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.540531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.541178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.541459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.541729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.542482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.544096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.554015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 801/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.554823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.564362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce7afc-8822-4dd2-8a64-95e2eedecebf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.568828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.569451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.569730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.570002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.570702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.572339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.581628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 789/1590] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:49 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:49.582779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.586381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 802/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.586381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.595611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ab63-28d7-40c7-a1f1-bf8b5aa78329 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.598277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f93c-30ad-4f88-a4f8-03f6675f9c22 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.600130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.600802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.601084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.601359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.602145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.603035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde5fff-2ce6-4ece-8793-5f25d6468138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.603703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde5fff-2ce6-4ece-8793-5f25d6468138 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.603819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.603992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde5fff-2ce6-4ece-8793-5f25d6468138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.604445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde5fff-2ce6-4ece-8793-5f25d6468138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.605177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde5fff-2ce6-4ece-8793-5f25d6468138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.606774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde5fff-2ce6-4ece-8793-5f25d6468138 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.614789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 790/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.615685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.620714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 803/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.622065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.622367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.622650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.628677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7558-6387-42be-868b-0b33ecc82644 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.634935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.635759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.636048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.636330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.637056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.638651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.649648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] MFA Rules not processed for user `ff8c7140be0d4fe898fc7c5d0916c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:49.650584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 791/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.650850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:49.651255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.662202 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd497-1e74-4a24-8be1-40e6a8284a5e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.667205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.667878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.668171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.668451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.669211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.670965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.681742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 792/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.681742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.693891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4128-e2a9-48e7-af24-325fe50815e3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.699298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.700073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.700362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.700690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.701418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.703681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.714233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 793/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.715213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.726475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31971-9510-443e-8874-164b9de4b21d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.730544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 804/1597] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:49.730544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.734764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.736705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.736705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.736705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] PATH_INFO: `/v3/projects/0998832c5db04fe5b7e93fa392a693f8/users/994dc4b8b3e047ddbe501ff74f3c709d/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.739395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac199a2-16b2-467c-886f-fcdb20640e83 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.744917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.745577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.745857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.746129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.746855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.748552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.752660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0998832c5db04fe5b7e93fa392a693f8, user_id=994dc4b8b3e047ddbe501ff74f3c709d, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.755440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.763062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 805/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.763062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.772828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3c93-2246-4528-b23d-ad81429434de admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.781607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.782517 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.782806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.783110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.783850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.785570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.796055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 806/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:49.797283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.807433 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d7592-132b-446b-a037-85113ae5d6d3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.813648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.814582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.814864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.815244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] PATH_INFO: `/v3/projects/52f7ff6557334462979f9934251c2158/users/721476a70afb4d1095a89215f1016045/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.831270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f7ff6557334462979f9934251c2158, user_id=721476a70afb4d1095a89215f1016045, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.833926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.836515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 794/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:49 2022] PUT /identity/v3/projects/0998832c5db04fe5b7e93fa392a693f8/users/994dc4b8b3e047ddbe501ff74f3c709d/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:49.840121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.900675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66612eac-beba-4cf4-80f5-5fd7c8cbb506 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.905558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.906763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.907073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.907351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] PATH_INFO: `/v3/projects/50b0b4d5de7e4f43bf553e2e5ef400b5/users/95a19e09db8a4fa39bef4c39fc35713f/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:49.924433 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 807/1601] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:49 2022] PUT /identity/v3/projects/52f7ff6557334462979f9934251c2158/users/721476a70afb4d1095a89215f1016045/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:49.925298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:49.928111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b0b4d5de7e4f43bf553e2e5ef400b5, user_id=95a19e09db8a4fa39bef4c39fc35713f, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:49.931609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:49.993087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5dd5-f1e2-44c0-af80-b22adf75b381 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:49.997830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:49.998504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:49.998791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:49.999765 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.000752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.002421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.008998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 795/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:49 2022] PUT /identity/v3/projects/50b0b4d5de7e4f43bf553e2e5ef400b5/users/95a19e09db8a4fa39bef4c39fc35713f/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:50.014017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.016205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 808/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:50.017854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.028176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41f9ba-f1ef-4903-9cb8-d270214e3325 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.076604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d723c-dce5-45bc-888d-27d69681b8a8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.082691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.083403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.083690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.083974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.084679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.086626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.087646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81321db-f5f3-4d2b-8f6b-1847787d5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.088528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81321db-f5f3-4d2b-8f6b-1847787d5ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.088814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81321db-f5f3-4d2b-8f6b-1847787d5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.089093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81321db-f5f3-4d2b-8f6b-1847787d5ac1 admin admin] PATH_INFO: `/v3/projects/313205376c674bc89fd654cc8b357d71/users/e2016544ffa64f2b8008f9a727bd7afb/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.105682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81321db-f5f3-4d2b-8f6b-1847787d5ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313205376c674bc89fd654cc8b357d71, user_id=e2016544ffa64f2b8008f9a727bd7afb, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.108386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81321db-f5f3-4d2b-8f6b-1847787d5ac1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.163162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 796/1604] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:50.163162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.187857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 809/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:50 2022] PUT /identity/v3/projects/313205376c674bc89fd654cc8b357d71/users/e2016544ffa64f2b8008f9a727bd7afb/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:50.189372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f522-2120-4e4c-9c2b-3411495849ab None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.189724 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f522-2120-4e4c-9c2b-3411495849ab None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.190173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f522-2120-4e4c-9c2b-3411495849ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.212808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-33f0f522-2120-4e4c-9c2b-3411495849ab None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.214444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-33f0f522-2120-4e4c-9c2b-3411495849ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.248579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e596b-e35b-462c-bcbf-f5f15177dc95 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.276949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 810/1606] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:50.278208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bbaf4-783e-472c-9c54-a4fc0726e6d6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.278574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bbaf4-783e-472c-9c54-a4fc0726e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.278929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bbaf4-783e-472c-9c54-a4fc0726e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.298420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ee8bbaf4-783e-472c-9c54-a4fc0726e6d6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.299709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ee8bbaf4-783e-472c-9c54-a4fc0726e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.307873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 811/1607] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:50.309046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.310609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.310609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.315749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.316656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.316939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.317216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] PATH_INFO: `/v3/projects/d61287a330cd4af9bd9dc26fd4dbd32c/users/0d6cc9c45f4d4177b166d87eb71f6447/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.333896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61287a330cd4af9bd9dc26fd4dbd32c, user_id=0d6cc9c45f4d4177b166d87eb71f6447, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.336877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.339123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] MFA Rules not processed for user `95a19e09db8a4fa39bef4c39fc35713f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.340401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.406053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 797/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:50 2022] PUT /identity/v3/projects/d61287a330cd4af9bd9dc26fd4dbd32c/users/0d6cc9c45f4d4177b166d87eb71f6447/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:50.408030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.414670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 812/1609] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:50.416150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.431790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889141ea-55db-42af-bcb3-2505fd0d8f8e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.484669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964a8e-cfcf-4fec-9389-8b1efe363c32 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.489615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.490665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.490973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.491360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] PATH_INFO: `/v3/projects/abd8d070b5774718a1d4cba279b35b76/users/f19a4b11e9564e4f86fcdd401bfdac15/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.491992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05630599-80aa-4b38-a36c-115a6871a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.492671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05630599-80aa-4b38-a36c-115a6871a5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.492957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05630599-80aa-4b38-a36c-115a6871a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.493232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05630599-80aa-4b38-a36c-115a6871a5fc admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.494073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05630599-80aa-4b38-a36c-115a6871a5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.495924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05630599-80aa-4b38-a36c-115a6871a5fc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.507990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd8d070b5774718a1d4cba279b35b76, user_id=f19a4b11e9564e4f86fcdd401bfdac15, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.510659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.607020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 813/1610] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:50.607020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.607020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.607020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.613002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 798/1611] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:50 2022] PUT /identity/v3/projects/abd8d070b5774718a1d4cba279b35b76/users/f19a4b11e9564e4f86fcdd401bfdac15/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:50.614135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.635254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] MFA Rules not processed for user `e2016544ffa64f2b8008f9a727bd7afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.636636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.671102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098216-7c36-4307-b8ab-8ef4498a7f25 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.675421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214bbc-d5f1-43de-aab2-7e76b39f738a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.676161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214bbc-d5f1-43de-aab2-7e76b39f738a service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.676432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214bbc-d5f1-43de-aab2-7e76b39f738a service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.676710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214bbc-d5f1-43de-aab2-7e76b39f738a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.704941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 814/1612] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:50.705732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.720136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376530f-06c0-4c55-b9fb-a9b2d3fb2722 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.724163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43aac-c684-430e-a36c-4d4128437e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.725245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43aac-c684-430e-a36c-4d4128437e12 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.725535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43aac-c684-430e-a36c-4d4128437e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.725817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43aac-c684-430e-a36c-4d4128437e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.750304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214bbc-d5f1-43de-aab2-7e76b39f738a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.752332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214bbc-d5f1-43de-aab2-7e76b39f738a service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.772349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 799/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:50.773597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774702e-cbac-44ee-895c-c23e562efa98 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.773890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774702e-cbac-44ee-895c-c23e562efa98 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.774162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774702e-cbac-44ee-895c-c23e562efa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.793194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2774702e-cbac-44ee-895c-c23e562efa98 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.794415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2774702e-cbac-44ee-895c-c23e562efa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.797555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f43aac-c684-430e-a36c-4d4128437e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.799871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f43aac-c684-430e-a36c-4d4128437e12 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.803869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 800/1614] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:50.805277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971a630-41fd-4d39-a9f6-114faa7c54ec None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.805657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971a630-41fd-4d39-a9f6-114faa7c54ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.806285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971a630-41fd-4d39-a9f6-114faa7c54ec None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.807725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 801/1615] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 18:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:15:50.808442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971a630-41fd-4d39-a9f6-114faa7c54ec None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.817564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 815/1616] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:50.820824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.820824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.820824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.823928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971a630-41fd-4d39-a9f6-114faa7c54ec None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.829719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.830517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.830802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.831093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.831827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.833533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.840230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.841749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.844668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 802/1617] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:50.845569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.854626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 816/1618] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:50.855605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.856608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd797-08b2-48e6-9fb6-d0ed1d29872f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.862149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.862894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.863267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.863545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.864428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.866389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.867418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48451e64-f7f5-43b0-9719-660e6b563095 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:50.871359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802005e-8b60-4701-ad7f-60974cf40ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:50.872017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802005e-8b60-4701-ad7f-60974cf40ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.872307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802005e-8b60-4701-ad7f-60974cf40ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.872589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802005e-8b60-4701-ad7f-60974cf40ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.883987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802005e-8b60-4701-ad7f-60974cf40ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:50.887185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802005e-8b60-4701-ad7f-60974cf40ab2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:50.900767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 817/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:50.901938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:50.902231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:50.906419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:50.924928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:50.926059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:50.978811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 803/1620] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:50.980526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:50.998911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 818/1621] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:51.000960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.013004 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086b0d4-6d8c-47d5-9f85-9b5b7abd8242 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.082945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.087607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.087607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.087607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.128608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e65e-d908-4428-9c05-9fce391c5793 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.136136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.137800 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.138284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.138835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] PATH_INFO: `/v3/projects/50cd161930da45fab9f124a1b53bbf65/users/8c1fc0b0172c410cabccac616c02fdfd/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.164672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cd161930da45fab9f124a1b53bbf65, user_id=8c1fc0b0172c410cabccac616c02fdfd, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.168350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.182345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.183758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.205218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 819/1622] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:51.209123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.226016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bab21-2e99-4760-8e0c-9e8c1bf8010e service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.233276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.234031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.234323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.234608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.235365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.237857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.318860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 804/1623] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:50 2022] PUT /identity/v3/projects/50cd161930da45fab9f124a1b53bbf65/users/8c1fc0b0172c410cabccac616c02fdfd/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:51.320176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.362066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 820/1624] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:51 2022] POST /identity/v3/users => generated 309 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:51.363868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.382586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67580dc-542b-43e2-b967-b09e90973365 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.464759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11123b3-6800-43fb-b10d-a7e9d680e09a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.474503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.475527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.476644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.477191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.502269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.503364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.503838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.504122 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.506718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.508567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.529910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 821/1625] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:51.532969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.544718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62d18c-27e6-445e-875e-99c14f67cb32 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.553027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.553900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.554198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.554475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.555354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.556923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.579083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 822/1626] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:51.580896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.584863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.588167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.606681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc860b-2013-48ac-a5b2-4c47065efa9c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.614072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400f09-951f-4fd6-9c22-a73be58fab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.615758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400f09-951f-4fd6-9c22-a73be58fab6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.615876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400f09-951f-4fd6-9c22-a73be58fab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.616068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400f09-951f-4fd6-9c22-a73be58fab6b admin admin] PATH_INFO: `/v3/projects/50cd161930da45fab9f124a1b53bbf65/users/8c1fc0b0172c410cabccac616c02fdfd/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.616423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 805/1627] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:51.617428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.618260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad400f09-951f-4fd6-9c22-a73be58fab6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cd161930da45fab9f124a1b53bbf65, user_id=8c1fc0b0172c410cabccac616c02fdfd, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.621753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad400f09-951f-4fd6-9c22-a73be58fab6b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.645306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc38f4-2840-4e10-aa0f-31e626d2e456 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:51.688688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 823/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:51 2022] PUT /identity/v3/projects/50cd161930da45fab9f124a1b53bbf65/users/8c1fc0b0172c410cabccac616c02fdfd/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:51.693277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa07e-0210-495d-835f-315d68079922 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.693277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa07e-0210-495d-835f-315d68079922 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.693277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa07e-0210-495d-835f-315d68079922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.744022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-894aa07e-0210-495d-835f-315d68079922 None None] MFA Rules not processed for user `8c1fc0b0172c410cabccac616c02fdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:51.745487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-894aa07e-0210-495d-835f-315d68079922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:51.767717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:51.768634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:51.768923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:51.769206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] PATH_INFO: `/v3/projects/56e1c5d1e420460e942b587654a7fca9/users/a75c8a83a6cd4eacbb110ec3158810da/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:51.805279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e1c5d1e420460e942b587654a7fca9, user_id=a75c8a83a6cd4eacbb110ec3158810da, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:51.808062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:51.881791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 824/1629] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:51.892729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 806/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:51 2022] PUT /identity/v3/projects/56e1c5d1e420460e942b587654a7fca9/users/a75c8a83a6cd4eacbb110ec3158810da/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:51.893846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa07e-0210-495d-835f-315d68079922 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.900585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:51.914611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa07e-0210-495d-835f-315d68079922 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:52.008351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d6be-d0d0-4190-b179-f809f306ee2b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:52.018954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15d76-384c-4558-9177-54c90dd79610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:52.019239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15d76-384c-4558-9177-54c90dd79610 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.019532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15d76-384c-4558-9177-54c90dd79610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.019816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15d76-384c-4558-9177-54c90dd79610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.034520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:52.035181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.035469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.035751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.036733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:52.043884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:52.064888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 825/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:52.070574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:52.087281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896addf-c47f-4160-b805-d2de3960e8d8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:52.101797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfbf6c-149b-4871-b187-b30227627eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:52.102854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbf6c-149b-4871-b187-b30227627eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.103263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbf6c-149b-4871-b187-b30227627eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.103655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbf6c-149b-4871-b187-b30227627eb5 admin admin] PATH_INFO: `/v3/projects/56e1c5d1e420460e942b587654a7fca9/users/a75c8a83a6cd4eacbb110ec3158810da/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.109992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbf6c-149b-4871-b187-b30227627eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e1c5d1e420460e942b587654a7fca9, user_id=a75c8a83a6cd4eacbb110ec3158810da, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:52.113536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbf6c-149b-4871-b187-b30227627eb5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:52.134274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 826/1632] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:52 2022] PUT /identity/v3/projects/56e1c5d1e420460e942b587654a7fca9/users/a75c8a83a6cd4eacbb110ec3158810da/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:52.139795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a386-abc8-44a9-91f6-5fe6e82dcdba None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.139795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a386-abc8-44a9-91f6-5fe6e82dcdba None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.139795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a386-abc8-44a9-91f6-5fe6e82dcdba None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.140866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 827/1633] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 18:15:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:15:52.150124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.151594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.152215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.153226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15d76-384c-4558-9177-54c90dd79610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:52.154835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15d76-384c-4558-9177-54c90dd79610 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:52.181917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 807/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:15:52.183521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.183917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.184304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.196566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:52.205111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:52.250902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] MFA Rules not processed for user `a75c8a83a6cd4eacbb110ec3158810da`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:52.253426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:52.300832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 828/1635] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:52.315663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:52.379896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 808/1636] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:52.417549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977028-6d8e-4d44-b43e-1fd8e01a720a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:52.422257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:52.423648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.423953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.424923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.442717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:52.444833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:52.462643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 829/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:52.507435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:52.522954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151dd0-93ab-4780-a299-d8c2984557ec None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:52.527952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73969-bea3-4e66-b6e7-0d7d437f3e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:52.528890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73969-bea3-4e66-b6e7-0d7d437f3e52 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.529256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73969-bea3-4e66-b6e7-0d7d437f3e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.529907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73969-bea3-4e66-b6e7-0d7d437f3e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.541539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73969-bea3-4e66-b6e7-0d7d437f3e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:52.543420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73969-bea3-4e66-b6e7-0d7d437f3e52 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:52.554444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 809/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:52.657282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:52.666914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ce6d-25bc-451a-8e82-3041fa9c8241 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:52.685987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97c672-215b-4a04-b4a0-deebf555bd18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:52.687223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c672-215b-4a04-b4a0-deebf555bd18 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:52.687838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c672-215b-4a04-b4a0-deebf555bd18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:52.688232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c672-215b-4a04-b4a0-deebf555bd18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:52.840055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97c672-215b-4a04-b4a0-deebf555bd18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:52.851166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97c672-215b-4a04-b4a0-deebf555bd18 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:52.863541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 830/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:15:53.364581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b98d-8990-4447-a936-7513755025ab None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:53.365597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b98d-8990-4447-a936-7513755025ab None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:53.365910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b98d-8990-4447-a936-7513755025ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:53.417035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1fa0b98d-8990-4447-a936-7513755025ab None None] MFA Rules not processed for user `0d6cc9c45f4d4177b166d87eb71f6447`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:53.420410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1fa0b98d-8990-4447-a936-7513755025ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:53.575502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 810/1640] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:53.588128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b6c1-5de6-4de4-a5f4-44ea103fe830 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:53.588653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b6c1-5de6-4de4-a5f4-44ea103fe830 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:53.588756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b6c1-5de6-4de4-a5f4-44ea103fe830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:53.622905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c371b6c1-5de6-4de4-a5f4-44ea103fe830 None None] MFA Rules not processed for user `0d6cc9c45f4d4177b166d87eb71f6447`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:53.625893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c371b6c1-5de6-4de4-a5f4-44ea103fe830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:53.651182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 831/1641] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:53.680017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bae3f-e174-446a-93ea-1ba1652e64b4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:53.680315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bae3f-e174-446a-93ea-1ba1652e64b4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:53.680600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bae3f-e174-446a-93ea-1ba1652e64b4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:53.682325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 811/1642] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 18:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:15:53.710873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2190b7-58da-4052-b645-0614d72be41a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:53.712839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2190b7-58da-4052-b645-0614d72be41a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:53.712839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2190b7-58da-4052-b645-0614d72be41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:53.754977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1f2190b7-58da-4052-b645-0614d72be41a None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:53.756385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1f2190b7-58da-4052-b645-0614d72be41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:53.778702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 832/1643] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:53.788347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bae3f-e174-446a-93ea-1ba1652e64b4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:53.795215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:53.795804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:53.795804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:53.829588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bae3f-e174-446a-93ea-1ba1652e64b4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:53.837443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:53.838112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:53.838404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:53.838684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:53.853755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] MFA Rules not processed for user `f19a4b11e9564e4f86fcdd401bfdac15`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:53.854977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:53.862164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:53.866543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:53.912625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 812/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:54.021171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 833/1645] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:15:54.025502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:54.122758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:54.223760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1add2-7e38-4463-9084-d8fa52152087 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:54.243126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:54.243817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.244104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.244386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.246593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:54.252360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:54.333962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba62c-26d3-4437-b523-560068802e9a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:54.345888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:54.347622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.347912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.348192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] PATH_INFO: `/v3/users/e2016544ffa64f2b8008f9a727bd7afb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.351096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2016544ffa64f2b8008f9a727bd7afb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:54.353871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:54.414350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 813/1646] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:15:54 2022] POST /identity/v3/projects => generated 405 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:15:54.419743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:54.528151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e287e6d-77c4-4444-a2f9-6ae2fa4b2c87 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:54.535590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bc645-4ea9-420c-a95d-1d61ee207bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:54.536619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc645-4ea9-420c-a95d-1d61ee207bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.537122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc645-4ea9-420c-a95d-1d61ee207bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.537637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc645-4ea9-420c-a95d-1d61ee207bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.538576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bc645-4ea9-420c-a95d-1d61ee207bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:54.540624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bc645-4ea9-420c-a95d-1d61ee207bf7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:54.609771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2016544ffa64f2b8008f9a727bd7afb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:54.626591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2016544ffa64f2b8008f9a727bd7afb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:54.627866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2016544ffa64f2b8008f9a727bd7afb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:54.628686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2016544ffa64f2b8008f9a727bd7afb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:54.634972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 814/1647] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:15:54 2022] POST /identity/v3/users => generated 309 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:15:54.634972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474826-1db4-45be-a88b-9674fd04a7b7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.634972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474826-1db4-45be-a88b-9674fd04a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.634972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474826-1db4-45be-a88b-9674fd04a7b7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.639348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 815/1648] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 18:15:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:15:54.641216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474826-1db4-45be-a88b-9674fd04a7b7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:54.646160 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c6474826-1db4-45be-a88b-9674fd04a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:54.708716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474826-1db4-45be-a88b-9674fd04a7b7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:54.723489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e24ada4b-b43f-478d-8d39-74453e34efda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2016544ffa64f2b8008f9a727bd7afb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:54.737645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c663d-e517-4e4b-a6ab-fe149adba424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:54.738346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c663d-e517-4e4b-a6ab-fe149adba424 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.738638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c663d-e517-4e4b-a6ab-fe149adba424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.738919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c663d-e517-4e4b-a6ab-fe149adba424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.743404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c663d-e517-4e4b-a6ab-fe149adba424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:54.745797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c663d-e517-4e4b-a6ab-fe149adba424 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:54.751894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 834/1649] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:15:54 2022] DELETE /identity/v3/users/e2016544ffa64f2b8008f9a727bd7afb => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:54.751894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.753926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.754260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.771304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 816/1650] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:54.775885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:54.781434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:54.782618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:54.824778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:54.825646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:54.828193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:54.830540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:54.973165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 817/1651] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:54.974400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:55.005294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5323cd-cfbc-4d64-9de6-82191a74672b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:55.010525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 835/1652] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:15:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:55.020856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:55.022058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:55.024594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:55.027120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] PATH_INFO: `/v3/projects/efda5aae1061419f9cc575f919ef6c02/users/3ed134d5a10e4360b5a53c152daacd55/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:55.028641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:55.031033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:55.065190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efda5aae1061419f9cc575f919ef6c02, user_id=3ed134d5a10e4360b5a53c152daacd55, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:55.068564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:55.150262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 818/1653] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:54 2022] PUT /identity/v3/projects/efda5aae1061419f9cc575f919ef6c02/users/3ed134d5a10e4360b5a53c152daacd55/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:55.151673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:55.162774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:55.170073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9a641-3260-4e7d-ab24-6adfbf0bf90c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:55.270645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac4b29-b064-415a-bec9-23139eaebe66 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:55.280875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:55.283684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:55.285191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:55.285610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:55.322374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12037d7-c3b6-465c-b39f-efbd60731b1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:55.324670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12037d7-c3b6-465c-b39f-efbd60731b1b service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:55.325465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12037d7-c3b6-465c-b39f-efbd60731b1b service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:55.325948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12037d7-c3b6-465c-b39f-efbd60731b1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:55.412485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:55.412485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:55.416105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 819/1654] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:55.416981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:55.427404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d17eb1-2c75-463b-a50a-e976abd25f80 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:55.432694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:55.433418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:55.433709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:55.434047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:55.434892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:55.436785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:55.445651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12037d7-c3b6-465c-b39f-efbd60731b1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:55.452697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12037d7-c3b6-465c-b39f-efbd60731b1b service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:55.452845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 820/1655] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:15:55.456149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:55.465497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 836/1656] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:15:55.469730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf86bf-39ee-45f3-a6a6-48caf29fa702 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:55.476173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bc9d-55b6-4439-b0fe-109d19f318f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:55.477071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bc9d-55b6-4439-b0fe-109d19f318f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:55.477360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bc9d-55b6-4439-b0fe-109d19f318f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:55.477645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bc9d-55b6-4439-b0fe-109d19f318f1 admin admin] PATH_INFO: `/v3/projects/efda5aae1061419f9cc575f919ef6c02/users/3ed134d5a10e4360b5a53c152daacd55/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:55.480556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bc9d-55b6-4439-b0fe-109d19f318f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efda5aae1061419f9cc575f919ef6c02, user_id=3ed134d5a10e4360b5a53c152daacd55, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:55.486679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bc9d-55b6-4439-b0fe-109d19f318f1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:55.514797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 821/1657] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:15:55 2022] PUT /identity/v3/projects/efda5aae1061419f9cc575f919ef6c02/users/3ed134d5a10e4360b5a53c152daacd55/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:15:56.056342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553057-9c87-4970-9ea2-5b8890f0852e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:56.060281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553057-9c87-4970-9ea2-5b8890f0852e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:56.062153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553057-9c87-4970-9ea2-5b8890f0852e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:56.339272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 837/1658] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 18:15:56 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:15:56.344017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:56.344017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:56.344017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:56.344017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:56.344017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:56.359533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 822/1659] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:15:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:56.418823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553057-9c87-4970-9ea2-5b8890f0852e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:56.421907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d5553057-9c87-4970-9ea2-5b8890f0852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:56.474627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553057-9c87-4970-9ea2-5b8890f0852e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:56.478721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:56.479979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:56.480133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:56.480529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:56.492095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:56.494174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:56.518059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 838/1660] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:15:56.833459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:56.839119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:57.045985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647f3e-db32-4f83-b17a-6fec174a456c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:57.052780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:57.053861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:57.054283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:57.054693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] PATH_INFO: `/v3/projects/313205376c674bc89fd654cc8b357d71` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:57.056139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313205376c674bc89fd654cc8b357d71)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:57.058228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:57.253884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313205376c674bc89fd654cc8b357d71', 'request_id': 'req-25950cd7-e222-4f45-a79b-53a299a50aa9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.325067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313205376c674bc89fd654cc8b357d71', 'request_id': 'req-25950cd7-e222-4f45-a79b-53a299a50aa9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.343184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313205376c674bc89fd654cc8b357d71', 'request_id': 'req-25950cd7-e222-4f45-a79b-53a299a50aa9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.382838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] The token cache is being invalidate because project 313205376c674bc89fd654cc8b357d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:15:57.383728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.395823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-25950cd7-e222-4f45-a79b-53a299a50aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.401395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 823/1661] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:15:56 2022] DELETE /identity/v3/projects/313205376c674bc89fd654cc8b357d71 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:57.405943 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:57.430743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d89b-0ac6-4a38-accc-d1fe5cd13d4d service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:57.588726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:57.594974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:57.595471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:57.595896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] PATH_INFO: `/v3/users/a75c8a83a6cd4eacbb110ec3158810da` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:57.597593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75c8a83a6cd4eacbb110ec3158810da)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:57.601296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:57.743920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39a46-cd75-4a94-8b9b-c23389128bc8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:57.744258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39a46-cd75-4a94-8b9b-c23389128bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:57.744546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39a46-cd75-4a94-8b9b-c23389128bc8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:57.746411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 824/1662] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 18:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:15:57.756415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:57.756415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:57.756695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:57.797222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] MFA Rules not processed for user `dd702379f5004159abc50fab8d398a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:57.798692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:57.865200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75c8a83a6cd4eacbb110ec3158810da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.900193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75c8a83a6cd4eacbb110ec3158810da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.900960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75c8a83a6cd4eacbb110ec3158810da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.901838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75c8a83a6cd4eacbb110ec3158810da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:57.974794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 825/1663] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:15:57.987837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75c8a83a6cd4eacbb110ec3158810da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:58.004859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:58.019735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebfe7-98ec-48b6-a90d-237eadef39c4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:58.026971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 839/1664] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:15:57 2022] DELETE /identity/v3/users/a75c8a83a6cd4eacbb110ec3158810da => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:58.204714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:58.208618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:58.209680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:58.210135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:58.220609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:58.256475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:58.258729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee017047-08a0-4f8c-86c8-afe529b6d3f3 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:58.279078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 826/1665] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:15:58.281430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:58.283966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:58.444429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef792e-3894-40eb-ab6e-f9fa82ad946e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:58.471553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:58.472467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:58.478926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:58.478926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] PATH_INFO: `/v3/users/95a19e09db8a4fa39bef4c39fc35713f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:58.479408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a19e09db8a4fa39bef4c39fc35713f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:58.481302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:58.757889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a19e09db8a4fa39bef4c39fc35713f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:58.797378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a19e09db8a4fa39bef4c39fc35713f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:58.803188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a19e09db8a4fa39bef4c39fc35713f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:58.803917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a19e09db8a4fa39bef4c39fc35713f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:58.871418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a19e09db8a4fa39bef4c39fc35713f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:15:58.895036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 840/1666] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:15:58 2022] DELETE /identity/v3/users/95a19e09db8a4fa39bef4c39fc35713f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:15:58.899208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:58.900048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:58.900472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:58.936668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:15:58.937874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:59.081753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 827/1667] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:15:59.104472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:59.106755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:59.254062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a961a1-b390-46b0-ba9c-bb67c023df48 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:59.262444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96855c12-8577-4d7e-9ba7-ffc88f5d44af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:59.263163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855c12-8577-4d7e-9ba7-ffc88f5d44af service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:59.263454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855c12-8577-4d7e-9ba7-ffc88f5d44af service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:59.263737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855c12-8577-4d7e-9ba7-ffc88f5d44af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:59.289300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96855c12-8577-4d7e-9ba7-ffc88f5d44af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:59.291031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96855c12-8577-4d7e-9ba7-ffc88f5d44af service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:15:59.319344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 841/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:15:59.912319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:15:59.914581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:15:59.950183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cc567-c8d4-45ee-8e84-114115798242 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:15:59.960202 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:15:59.962559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:15:59.963572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:15:59.964073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] PATH_INFO: `/v3/projects/56e1c5d1e420460e942b587654a7fca9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:15:59.967727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e1c5d1e420460e942b587654a7fca9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:15:59.971875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:00.036684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f343-9901-413e-840e-36606557c84d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.037181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f343-9901-413e-840e-36606557c84d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.037257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f343-9901-413e-840e-36606557c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.095998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dd18f343-9901-413e-840e-36606557c84d None None] MFA Rules not processed for user `3ed134d5a10e4360b5a53c152daacd55`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:00.097309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dd18f343-9901-413e-840e-36606557c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:00.169026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e1c5d1e420460e942b587654a7fca9', 'request_id': 'req-85ffcf04-5c76-4b04-8a9c-52f8025fa521'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.262952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 842/1669] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:00.312682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e1c5d1e420460e942b587654a7fca9', 'request_id': 'req-85ffcf04-5c76-4b04-8a9c-52f8025fa521'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.321109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e1c5d1e420460e942b587654a7fca9', 'request_id': 'req-85ffcf04-5c76-4b04-8a9c-52f8025fa521'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.352188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] The token cache is being invalidate because project 56e1c5d1e420460e942b587654a7fca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:00.355891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.359276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-85ffcf04-5c76-4b04-8a9c-52f8025fa521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.361927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f343-9901-413e-840e-36606557c84d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:00.363063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 828/1670] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:15:59 2022] DELETE /identity/v3/projects/56e1c5d1e420460e942b587654a7fca9 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:00.363495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dd18f343-9901-413e-840e-36606557c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:00.367426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233fa18-9a07-4b4a-8605-fab5ac213b91 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.367857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233fa18-9a07-4b4a-8605-fab5ac213b91 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.368251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233fa18-9a07-4b4a-8605-fab5ac213b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.386779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f343-9901-413e-840e-36606557c84d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:00.423872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c233fa18-9a07-4b4a-8605-fab5ac213b91 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:00.425154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c233fa18-9a07-4b4a-8605-fab5ac213b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:00.553274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:00.554170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.554461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.554739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] PATH_INFO: `/v3/projects/50b0b4d5de7e4f43bf553e2e5ef400b5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.561703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b0b4d5de7e4f43bf553e2e5ef400b5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:00.565078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:16:00.565078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: warnings.warn(msg) May 04 18:16:00.565078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: May 04 18:16:00.571453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:00.581331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 829/1671] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:00.583399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.583703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.583995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.664516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:00.674713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:00.731017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 830/1672] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:00.741356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:00.770205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da68e2-164d-4e17-bec4-e7f158e16269 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:00.788395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b0b4d5de7e4f43bf553e2e5ef400b5', 'request_id': 'req-2ddb276b-c41b-456f-a2ca-020863d248ea'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.854401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b0b4d5de7e4f43bf553e2e5ef400b5', 'request_id': 'req-2ddb276b-c41b-456f-a2ca-020863d248ea'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.867089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b0b4d5de7e4f43bf553e2e5ef400b5', 'request_id': 'req-2ddb276b-c41b-456f-a2ca-020863d248ea'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.922721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] The token cache is being invalidate because project 50b0b4d5de7e4f43bf553e2e5ef400b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:00.923256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.923920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ddb276b-c41b-456f-a2ca-020863d248ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:00.925029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:00.927032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 843/1673] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:00 2022] DELETE /identity/v3/projects/50b0b4d5de7e4f43bf553e2e5ef400b5 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:00.932173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.932173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.934510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.935550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:00.936535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1fc10-96d3-4e2a-aed1-461e37bac7e8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.937219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1fc10-96d3-4e2a-aed1-461e37bac7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.937848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:00.938304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1fc10-96d3-4e2a-aed1-461e37bac7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.940172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:00.964096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 831/1674] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:00.968857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:00.973206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:00.974534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-89a1fc10-96d3-4e2a-aed1-461e37bac7e8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:00.976076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-89a1fc10-96d3-4e2a-aed1-461e37bac7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:00.989894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad48196-7855-4483-9906-e762de374f9e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:00.996128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:00.997172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:00.997716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:00.998254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:00.999610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.002220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.002554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 844/1675] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:01.004233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.004529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.004805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.032484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:01.033698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:01.042958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 845/1676] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:01.051280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.068173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668154-a774-4e8c-a53a-c3a1957fd8a7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.080909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.081847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.082393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.082708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.083533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:01.083844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.089953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.120084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 846/1677] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:01.126229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.155225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 832/1678] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:00 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:01.159402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.165304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670daba-a5e7-491e-a97c-a01e9d9df7b4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.314919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.315612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.315897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.316178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.320310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.324837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.375371 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664360-a9c5-47c7-bf58-c599925c0017 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.381801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.383667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.384171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.384650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.386056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.388654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.436929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 847/1679] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:01 2022] POST /identity/v3/projects => generated 367 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:01.445206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.500333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 833/1680] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:01 2022] POST /identity/v3/users => generated 291 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:01.507376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.529014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32367-45cf-452e-b153-9209a747b3dd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.599067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e47f2-8302-4e30-ad3f-60e084b755d6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.606911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.608773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.609246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.610218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.611140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.616133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.628442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.629124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.629415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.629700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.630442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.632095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.655185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 834/1681] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:01.656583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.682239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81323a25-f204-4684-a815-d97b10fd12c4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.689826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.690653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.691493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.691572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.692455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.695810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.716667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 835/1682] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:01.718442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.743135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 848/1683] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:01 2022] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:01.748499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.763229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556b54a-d82a-421b-a21b-33fba9c2f29d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.772391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbc297-ade2-4b03-b406-50c40f62ff2b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.784658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42676-eec7-4763-875b-cd1788d634d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.785835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42676-eec7-4763-875b-cd1788d634d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.786127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42676-eec7-4763-875b-cd1788d634d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.786413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42676-eec7-4763-875b-cd1788d634d3 admin admin] PATH_INFO: `/v3/projects/2611aa9f7b1146d298abadbd97abb946/users/0d24495e2b76479f814b87967e2b2665/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.787917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.790345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.791019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.791879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.795285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.798276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.832085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 849/1684] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:01.836633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.840433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42676-eec7-4763-875b-cd1788d634d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2611aa9f7b1146d298abadbd97abb946, user_id=0d24495e2b76479f814b87967e2b2665, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.848223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42676-eec7-4763-875b-cd1788d634d3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.896255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a5ef-0141-4589-b90f-57e050351776 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.896255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.896255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.896255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.897393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.897393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.897393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.918001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 850/1685] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:01.921392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:01.940315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14340-02ff-4686-b2b9-4f849b5eecad admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:01.948051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d3113-0944-4bb7-8564-67e213f8082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:01.948051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d3113-0944-4bb7-8564-67e213f8082f admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.948325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d3113-0944-4bb7-8564-67e213f8082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.949379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d3113-0944-4bb7-8564-67e213f8082f admin admin] PATH_INFO: `/v3/projects/2027b9dba2044d9fa9f4ebaf61db04e1/users/120d55fa79fe4b1d83e0c4f820a3db50/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:01.970609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d3113-0944-4bb7-8564-67e213f8082f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2027b9dba2044d9fa9f4ebaf61db04e1, user_id=120d55fa79fe4b1d83e0c4f820a3db50, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:01.994733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 836/1686] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:01 2022] PUT /identity/v3/projects/2611aa9f7b1146d298abadbd97abb946/users/0d24495e2b76479f814b87967e2b2665/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:01.995362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d3113-0944-4bb7-8564-67e213f8082f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:01.996009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:01.996309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:01.996595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:02.095847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] MFA Rules not processed for user `0d24495e2b76479f814b87967e2b2665`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:02.101719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:02.105363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 851/1687] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:01 2022] PUT /identity/v3/projects/2027b9dba2044d9fa9f4ebaf61db04e1/users/120d55fa79fe4b1d83e0c4f820a3db50/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:02.117574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:02.118281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:02.118757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:02.195463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] MFA Rules not processed for user `120d55fa79fe4b1d83e0c4f820a3db50`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:02.200447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:02.307836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 837/1688] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:02.311510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:02.380072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 852/1689] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:02.384514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:02.510378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f971e1-ad99-49fe-abf6-d878e5c948cd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:02.530955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:02.531666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:02.531949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:02.532224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:02.532935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:02.534834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:02.656105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713e5ec-80e3-4b9e-98f6-60d1d2a86de6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:02.667940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 838/1690] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:02 2022] POST /identity/v3/projects => generated 379 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:02.672701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:02.678953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:02.679675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:02.679966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:02.680246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:02.696650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:02.710856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:02.835029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 853/1691] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:02 2022] POST /identity/v3/projects => generated 369 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:02.836408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:02.865539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc89e6-755f-4885-bd26-1854cd5a0017 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:02.936908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:02.937893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:02.938340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:02.938722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:02.939727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:02.941915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.017296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549a312-e0c2-44d1-9abf-ff7c4629a690 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.031563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.032266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.032551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.032848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.033537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.040536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.047344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 839/1692] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:02 2022] POST /identity/v3/users => generated 296 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:03.048979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.080094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5422b0-93a2-4db8-b06a-e64908054b00 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.093294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.093965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.095238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.096863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.098132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.105764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.134401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 840/1693] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:03.137491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.167685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f51d75-b739-4bc9-823b-d58096fa4d84 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.179819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.180756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.181593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.181886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] PATH_INFO: `/v3/projects/1ec77bdb647e47949780fb3c66c54025/users/a904543f1af94d18ba0d87088abf59ba/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.203804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 854/1694] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:02 2022] POST /identity/v3/users => generated 291 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:03.207777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.234720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c98fef-6646-4512-be61-1da7a4473db8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.244170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec77bdb647e47949780fb3c66c54025, user_id=a904543f1af94d18ba0d87088abf59ba, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.245816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.246579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.246937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.247147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.247358 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.249418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.251098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.277860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 855/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:03.281552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.298966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47fa1f-f1b0-4889-aa39-f04a1beecbbd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.320744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.322063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.322419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.322766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] PATH_INFO: `/v3/projects/ac58d0758f264c038bd6c9005f5efac3/users/aac89c7f9b7f412a92c6f47374fcd2a8/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.345026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 841/1696] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:03 2022] PUT /identity/v3/projects/1ec77bdb647e47949780fb3c66c54025/users/a904543f1af94d18ba0d87088abf59ba/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:03.348854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac58d0758f264c038bd6c9005f5efac3, user_id=aac89c7f9b7f412a92c6f47374fcd2a8, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.349867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.363927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.459744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 856/1697] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:03 2022] PUT /identity/v3/projects/ac58d0758f264c038bd6c9005f5efac3/users/aac89c7f9b7f412a92c6f47374fcd2a8/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:03.465280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.500534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb435-5248-4ba9-bc5c-6507f3fd34e5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.589870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828d4f-c90a-4050-9529-c1b2a13e0419 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.600191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.601574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.602742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.603190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.605551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.612469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.631895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 857/1698] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:03.645355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.649620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.650540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.651467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.652066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.652975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.655189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.664604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff964-b183-4e96-80cd-56d9ecbc0edf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.675500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.676415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.676768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.676962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] PATH_INFO: `/v3/projects/ac58d0758f264c038bd6c9005f5efac3/users/aac89c7f9b7f412a92c6f47374fcd2a8/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.683745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 842/1699] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:03.687415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.689356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac58d0758f264c038bd6c9005f5efac3, user_id=aac89c7f9b7f412a92c6f47374fcd2a8, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.691926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.694529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:03.733997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 858/1700] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:03 2022] PUT /identity/v3/projects/ac58d0758f264c038bd6c9005f5efac3/users/aac89c7f9b7f412a92c6f47374fcd2a8/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:03.743906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9767d9-375e-4af3-aa20-d5a34eeb4b59 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.750612 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:03.876856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.878614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.878913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.879227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] PATH_INFO: `/v3/users/f19a4b11e9564e4f86fcdd401bfdac15` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.880788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19a4b11e9564e4f86fcdd401bfdac15)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.882730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:16:03.882730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: warnings.warn(msg) May 04 18:16:03.882730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: May 04 18:16:03.884330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.895873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6184e-c382-4187-9636-b2eedde0f0ae admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:03.902771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8684ae3-4410-436c-a81b-57011171a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:03.905457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684ae3-4410-436c-a81b-57011171a9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.905948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684ae3-4410-436c-a81b-57011171a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.906565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684ae3-4410-436c-a81b-57011171a9c1 admin admin] PATH_INFO: `/v3/projects/1ec77bdb647e47949780fb3c66c54025/users/a904543f1af94d18ba0d87088abf59ba/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:03.909149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8684ae3-4410-436c-a81b-57011171a9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec77bdb647e47949780fb3c66c54025, user_id=a904543f1af94d18ba0d87088abf59ba, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:03.929215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8684ae3-4410-436c-a81b-57011171a9c1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:03.955906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 859/1701] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:03 2022] PUT /identity/v3/projects/1ec77bdb647e47949780fb3c66c54025/users/a904543f1af94d18ba0d87088abf59ba/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:03.958327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d663c-f74d-44bf-b1fc-55d162e3e0da None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:03.960221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d663c-f74d-44bf-b1fc-55d162e3e0da None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:03.960468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d663c-f74d-44bf-b1fc-55d162e3e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:04.028992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3c3d663c-f74d-44bf-b1fc-55d162e3e0da None None] MFA Rules not processed for user `aac89c7f9b7f412a92c6f47374fcd2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:04.031322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3c3d663c-f74d-44bf-b1fc-55d162e3e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:04.164869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19a4b11e9564e4f86fcdd401bfdac15'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:04.174158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19a4b11e9564e4f86fcdd401bfdac15'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:04.179163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 860/1702] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:04.180510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:04.180808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:04.181090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:04.221062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19a4b11e9564e4f86fcdd401bfdac15'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:04.221948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19a4b11e9564e4f86fcdd401bfdac15'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:04.228019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] MFA Rules not processed for user `a904543f1af94d18ba0d87088abf59ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:04.229277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:04.321687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19a4b11e9564e4f86fcdd401bfdac15'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:04.353972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 843/1703] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:03 2022] DELETE /identity/v3/users/f19a4b11e9564e4f86fcdd401bfdac15 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:04.355248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:04.365191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 861/1704] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:04.366731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:04.385175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:04.386811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:04.516854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3efefa-d79f-493e-b34d-70286ab566a7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:04.522463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477784c-4419-44e7-8a54-aa755641c8c1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:04.527012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:04.530041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:04.531073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:04.531817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:04.533420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:04.533812 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:04.534221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:04.534687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:04.540713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:04.662592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:04.664109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:04.691322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 862/1705] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:04.692624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:04.696566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72de2cf-d6b2-4c4d-8391-8cbfa9ded996 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:04.737606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 844/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:04.889729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:04.895895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.062956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce6ae-d3b3-480d-971c-b4b69666032c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:05.070377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:05.071461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:05.071816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:05.072168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] PATH_INFO: `/v3/projects/abd8d070b5774718a1d4cba279b35b76` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:05.073791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd8d070b5774718a1d4cba279b35b76)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:05.077182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:05.156489 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:05.157022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:05.157469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:05.238062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] MFA Rules not processed for user `ba28b51976a54c89ac3beb5394b1ec76`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:05.240200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.264483 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd8d070b5774718a1d4cba279b35b76', 'request_id': 'req-98bf1c9e-fb15-47fd-9109-27c9854e6da5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:05.353614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd8d070b5774718a1d4cba279b35b76', 'request_id': 'req-98bf1c9e-fb15-47fd-9109-27c9854e6da5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:05.372452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 845/1707] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:05.380434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd8d070b5774718a1d4cba279b35b76', 'request_id': 'req-98bf1c9e-fb15-47fd-9109-27c9854e6da5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:05.381834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:05.455980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] The token cache is being invalidate because project abd8d070b5774718a1d4cba279b35b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:05.456325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:05.457096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:05.464967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 863/1708] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:04 2022] DELETE /identity/v3/projects/abd8d070b5774718a1d4cba279b35b76 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:05.464967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:05.468328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.595788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080971f-8193-4784-adb6-7cf692df8cce None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:05.602065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:05.603887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:05.604374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:05.604828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:05.607376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.691034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf1c9e-fb15-47fd-9109-27c9854e6da5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:05.708843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:05.709683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:05.709884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:05.710139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:05.713700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.735123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:05.737188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cf841-15f2-4668-b4f4-a81b14cfbd86 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:05.741438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:05.744356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:05.763841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 846/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:05.769345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:05.769901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 864/1710] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:05.770601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:05.771347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:05.773318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:05.775567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.872301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] MFA Rules not processed for user `994dc4b8b3e047ddbe501ff74f3c709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:05.874007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:05.995748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3946-20be-4ed4-8c70-0876154b344b service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:06.020542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:06.021631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:06.022096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:06.023281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] PATH_INFO: `/v3/users/3ed134d5a10e4360b5a53c152daacd55` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:06.030196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed134d5a10e4360b5a53c152daacd55)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:06.034765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 847/1711] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:06.048210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:06.052304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:06.053113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:06.081511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f04d2-0a6f-4a1c-94c4-d6e5edb45ac4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:06.100178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:06.109245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:06.109245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:06.109245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:06.119759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:06.125344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:06.145769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 848/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:06.355171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed134d5a10e4360b5a53c152daacd55'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:06.385616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed134d5a10e4360b5a53c152daacd55'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:06.386248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed134d5a10e4360b5a53c152daacd55'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:06.389141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed134d5a10e4360b5a53c152daacd55'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:06.465161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ba74d86f-388b-4add-853c-cd7730bb7354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed134d5a10e4360b5a53c152daacd55'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:06.495063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 865/1713] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:05 2022] DELETE /identity/v3/users/3ed134d5a10e4360b5a53c152daacd55 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:07.389259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:07.408873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba582be-89aa-486d-9d7c-0f1f66e9b6ff service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:07.473448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77110d-c931-47ad-8e4f-f93c77407e5d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:07.474422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77110d-c931-47ad-8e4f-f93c77407e5d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:07.478476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77110d-c931-47ad-8e4f-f93c77407e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:07.576613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7d77110d-c931-47ad-8e4f-f93c77407e5d None None] MFA Rules not processed for user `721476a70afb4d1095a89215f1016045`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:07.583815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7d77110d-c931-47ad-8e4f-f93c77407e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:07.772789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 866/1714] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:07.788357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8cee6-fa91-4feb-9189-a92a902da466 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:07.788791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8cee6-fa91-4feb-9189-a92a902da466 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:07.789211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8cee6-fa91-4feb-9189-a92a902da466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:07.832391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-09d8cee6-fa91-4feb-9189-a92a902da466 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:07.833854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-09d8cee6-fa91-4feb-9189-a92a902da466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:07.991344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 867/1715] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:16:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:07.997522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:07.998144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:07.999295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.017770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:08.018655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.019043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.019246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] PATH_INFO: `/v3/projects/efda5aae1061419f9cc575f919ef6c02` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.020504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efda5aae1061419f9cc575f919ef6c02)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:08.022427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:08.034091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] MFA Rules not processed for user `721476a70afb4d1095a89215f1016045`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:08.036179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:08.063104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 868/1716] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:08.070905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:08.075966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:08.226849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efda5aae1061419f9cc575f919ef6c02', 'request_id': 'req-ac138cf2-463d-47b6-943f-efa30c9445a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:08.266911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23917c5c-95d8-4907-8f58-00af99bf8b8a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:08.365723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:08.366410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.366697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.367173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.380642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efda5aae1061419f9cc575f919ef6c02', 'request_id': 'req-ac138cf2-463d-47b6-943f-efa30c9445a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:08.387705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efda5aae1061419f9cc575f919ef6c02', 'request_id': 'req-ac138cf2-463d-47b6-943f-efa30c9445a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:08.423469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] The token cache is being invalidate because project efda5aae1061419f9cc575f919ef6c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:08.424045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:08.426170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac138cf2-463d-47b6-943f-efa30c9445a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:08.433086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 849/1717] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:07 2022] DELETE /identity/v3/projects/efda5aae1061419f9cc575f919ef6c02 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:08.439306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964367-c42d-47ea-9c0b-0c0f4c11dc0b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.439648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964367-c42d-47ea-9c0b-0c0f4c11dc0b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.441267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964367-c42d-47ea-9c0b-0c0f4c11dc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.492886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a6964367-c42d-47ea-9c0b-0c0f4c11dc0b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:08.496430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a6964367-c42d-47ea-9c0b-0c0f4c11dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:08.551344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:08.553070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:08.589940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 869/1718] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:08.590778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:08.595843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:08.721688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 850/1719] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:08.723547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.725394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.749381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.777342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:08.781141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:08.795822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 851/1720] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:08.796940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:08.807325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e41f87-60d3-42a1-a565-ece12ebe5732 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:08.827802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:08.828558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.828830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.829150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.829835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:08.830137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:08.831771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:08.846425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3ed54-5d28-4db8-8933-4e35d8642689 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:08.865522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:08.866676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.867151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.868179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.878742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:08.892455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 852/1721] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:08.894134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:08.917737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509c8c-3501-4454-959a-d15ed5e76dff admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:08.926095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:08.926095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:08.926486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:08.926641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:08.938667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:08.940517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:09.105813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 853/1722] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:08 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:09.113232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:09.232607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6589ba6-a15b-4478-b6cc-2ef5e4bb4ee9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:09.247807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:09.248983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:09.250514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:09.251602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:09.252679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:09.258385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:09.270021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:09.272581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:09.325126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 870/1723] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:16:09.389785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 854/1724] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:09 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:09.394727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:09.426904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf11e7-8423-47a4-952e-927de78baa2e service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:09.442379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:09.444584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:09.445247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:09.449815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:09.449815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:09.456174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:09.497679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 871/1725] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:09.498288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:09.525088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b792-4cff-4b6b-94fd-c1f9fd493169 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:09.542334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb99c-06a3-45a0-aada-99a5b287b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:09.546833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb99c-06a3-45a0-aada-99a5b287b840 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:09.547171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb99c-06a3-45a0-aada-99a5b287b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:09.549302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb99c-06a3-45a0-aada-99a5b287b840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:09.550116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb99c-06a3-45a0-aada-99a5b287b840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:09.562297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb99c-06a3-45a0-aada-99a5b287b840 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:09.609329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 855/1726] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:09.612136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:09.624619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805a06-fffa-45a8-8b90-c2020279c9be admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:09.650221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:09.651394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:09.651695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:09.652057 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] PATH_INFO: `/v3/projects/176aacd5faa443a78167c6ef29abf256/users/69352d6ffbfc44fab298ad2b2658365d/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:09.676702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176aacd5faa443a78167c6ef29abf256, user_id=69352d6ffbfc44fab298ad2b2658365d, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:09.684076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:09.852986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 872/1727] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:09 2022] PUT /identity/v3/projects/176aacd5faa443a78167c6ef29abf256/users/69352d6ffbfc44fab298ad2b2658365d/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:09.863890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:09.864587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:09.865032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:09.953145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] MFA Rules not processed for user `69352d6ffbfc44fab298ad2b2658365d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:09.956186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:10.206320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 856/1728] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:10.212731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:10.381424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759a79-4213-488f-b11e-c7f9754a7fc2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:10.414478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:10.420253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:10.422651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:10.423581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:10.424907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:10.433030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:10.582911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 873/1729] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:10 2022] POST /identity/v3/projects => generated 379 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:10.583921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:10.621712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95d20-7cd1-4611-9f1f-a1416c17a3be None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:10.903363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670003e2-dca8-40ae-8bed-d06afe1f4e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:10.903363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670003e2-dca8-40ae-8bed-d06afe1f4e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:10.903363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670003e2-dca8-40ae-8bed-d06afe1f4e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:10.903363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670003e2-dca8-40ae-8bed-d06afe1f4e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:10.905697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670003e2-dca8-40ae-8bed-d06afe1f4e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:10.905697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670003e2-dca8-40ae-8bed-d06afe1f4e74 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:11.304382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 857/1730] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:10 2022] POST /identity/v3/users => generated 296 bytes in 712 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:11.304570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:11.321599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71c17-9a6c-4d56-85ca-38fd01a901cc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:11.346436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:11.348558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:11.350566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:11.353659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:11.354692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:11.355010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:11.357894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:11.359913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:11.362408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:11.401235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 874/1731] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:11.420703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:11.456245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b7d14-1e8f-45b9-a61b-de4f119894ea admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:11.491986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350e38-41eb-4621-944f-74c540766546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:11.496427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350e38-41eb-4621-944f-74c540766546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:11.496967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350e38-41eb-4621-944f-74c540766546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:11.497321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350e38-41eb-4621-944f-74c540766546 admin admin] PATH_INFO: `/v3/projects/ad9c78862ca044cdad121243951e321a/users/fc77fa1afac24b94acdb390067ffa8c8/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:11.500606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:11.506910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:11.602380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350e38-41eb-4621-944f-74c540766546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9c78862ca044cdad121243951e321a, user_id=fc77fa1afac24b94acdb390067ffa8c8, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:11.607960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350e38-41eb-4621-944f-74c540766546 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:11.744497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 875/1732] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:11 2022] PUT /identity/v3/projects/ad9c78862ca044cdad121243951e321a/users/fc77fa1afac24b94acdb390067ffa8c8/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:11.750938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:11.750938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:11.750938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:11.792151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 858/1733] 10.222.0.84 () {58 vars in 1015 bytes} [Wed May 4 18:16:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:11.793886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:11.810095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] MFA Rules not processed for user `721476a70afb4d1095a89215f1016045`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:11.812512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:11.832165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b82ad4-8ef0-439d-b0e3-f70ab0588e64 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:11.916117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 876/1734] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:11.918904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:11.938248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:12.112053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:12.113637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:12.114109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:12.114605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:12.116051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:12.123888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:12.169126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 859/1735] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:12.170549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:12.183878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:12.249677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab43f3-25f9-4c84-bae6-05e9831d3107 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:12.256143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:12.257722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:12.258010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:12.258287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] PATH_INFO: `/v3/users/120d55fa79fe4b1d83e0c4f820a3db50` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:12.259783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120d55fa79fe4b1d83e0c4f820a3db50)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:12.262589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:12.411068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aabf32-d24a-495f-8345-63cfc5edf029 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:12.440764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:12.441796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:12.442293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:12.442787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:12.459151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:12.462471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:12.494065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 860/1736] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:12.498045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:12.521506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120d55fa79fe4b1d83e0c4f820a3db50'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:12.569167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf252-b515-4058-9c5a-5f50fd0fac72 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:12.603482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770456-b30a-4c3c-b30f-a4384870a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:12.605454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770456-b30a-4c3c-b30f-a4384870a5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:12.605798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120d55fa79fe4b1d83e0c4f820a3db50'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:12.607986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120d55fa79fe4b1d83e0c4f820a3db50'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:12.611312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120d55fa79fe4b1d83e0c4f820a3db50'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:12.614572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770456-b30a-4c3c-b30f-a4384870a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:12.615191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770456-b30a-4c3c-b30f-a4384870a5dd admin admin] PATH_INFO: `/v3/projects/ad9c78862ca044cdad121243951e321a/users/fc77fa1afac24b94acdb390067ffa8c8/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:12.621289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d770456-b30a-4c3c-b30f-a4384870a5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9c78862ca044cdad121243951e321a, user_id=fc77fa1afac24b94acdb390067ffa8c8, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:12.634140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d770456-b30a-4c3c-b30f-a4384870a5dd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:12.673574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 861/1737] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:12 2022] PUT /identity/v3/projects/ad9c78862ca044cdad121243951e321a/users/fc77fa1afac24b94acdb390067ffa8c8/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:12.686026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:12.686870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:12.687378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:12.688963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1de59e8b-6967-4bc1-947d-de109a104753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120d55fa79fe4b1d83e0c4f820a3db50'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:12.721543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 877/1738] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:11 2022] DELETE /identity/v3/users/120d55fa79fe4b1d83e0c4f820a3db50 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:12.723805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:12.724106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:12.724390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:12.733829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] MFA Rules not processed for user `fc77fa1afac24b94acdb390067ffa8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:12.735714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:12.772602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:12.777246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:12.916451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 862/1739] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:12.940357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:12.942309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:12.961734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 878/1740] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:13.034066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:13.038323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:13.101092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552443e2-3088-4651-a4cf-0aa34503ad0c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:13.111233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cee71-84f3-4f77-a3e9-9f42fa2a5c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:13.114656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cee71-84f3-4f77-a3e9-9f42fa2a5c6b service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:13.116479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cee71-84f3-4f77-a3e9-9f42fa2a5c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:13.116954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cee71-84f3-4f77-a3e9-9f42fa2a5c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:13.166474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cee71-84f3-4f77-a3e9-9f42fa2a5c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:13.168277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cee71-84f3-4f77-a3e9-9f42fa2a5c6b service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:13.219447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 863/1741] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:13.295853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c41a2a-f0c6-43e4-84d2-f8be7e47f700 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:13.321532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264d641-03e8-45f5-9299-a19da05aaa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:13.324777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d641-03e8-45f5-9299-a19da05aaa65 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:13.325120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d641-03e8-45f5-9299-a19da05aaa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:13.325436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d641-03e8-45f5-9299-a19da05aaa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:13.363200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264d641-03e8-45f5-9299-a19da05aaa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:13.368935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264d641-03e8-45f5-9299-a19da05aaa65 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:13.393461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 879/1742] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:13.683176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac2c9-0b06-4f9e-a801-da8f40aaa540 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:13.684246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac2c9-0b06-4f9e-a801-da8f40aaa540 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:13.684246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac2c9-0b06-4f9e-a801-da8f40aaa540 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:13.686557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 864/1743] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 18:16:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:16:13.716002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:13.716733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:13.716733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:13.760332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:13.764288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:13.800222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 880/1744] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:16:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:13.979080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac2c9-0b06-4f9e-a801-da8f40aaa540 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:14.004673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac2c9-0b06-4f9e-a801-da8f40aaa540 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:14.024476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0b089-43e7-4b61-a63c-caf732a913c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:14.025169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0b089-43e7-4b61-a63c-caf732a913c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:14.025458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0b089-43e7-4b61-a63c-caf732a913c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:14.025756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0b089-43e7-4b61-a63c-caf732a913c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:14.052198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0b089-43e7-4b61-a63c-caf732a913c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:14.053179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0b089-43e7-4b61-a63c-caf732a913c6 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:14.097056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 865/1745] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:14.264650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:14.266345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:14.289731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892ce91-6641-4fa3-97cc-8141185ea0ef None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:14.295072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:14.295986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:14.296337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:14.296621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] PATH_INFO: `/v3/users/69352d6ffbfc44fab298ad2b2658365d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:14.298829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=69352d6ffbfc44fab298ad2b2658365d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:14.301398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:14.630426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69352d6ffbfc44fab298ad2b2658365d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:14.639902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:14.641018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:14.642055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:14.743861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69352d6ffbfc44fab298ad2b2658365d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:14.756692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69352d6ffbfc44fab298ad2b2658365d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:14.757719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69352d6ffbfc44fab298ad2b2658365d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:14.781917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] MFA Rules not processed for user `ba28b51976a54c89ac3beb5394b1ec76`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:14.790317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:14.852733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-928db246-ce92-42f3-beac-01b9cf9102bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69352d6ffbfc44fab298ad2b2658365d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:14.890346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 881/1746] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:14 2022] DELETE /identity/v3/users/69352d6ffbfc44fab298ad2b2658365d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:14.895370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:14.895862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:14.896456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:14.938910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:14.940463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 866/1747] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:14.946730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:15.136558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 882/1748] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:15.155121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:15.160044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:15.233518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320c76-45bf-48c1-a28f-3dd8088efe6d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:15.415641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:15.423559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:15.423900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:15.424179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:15.453498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:15.455085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:15.508900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 867/1749] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:16.146740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:16.159216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:16.201224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd235e-96e0-4f07-b3c3-32b40036cc6a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:16.219877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:16.219877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:16.219877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:16.219877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] PATH_INFO: `/v3/projects/2027b9dba2044d9fa9f4ebaf61db04e1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:16.222608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2027b9dba2044d9fa9f4ebaf61db04e1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:16.225806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:16.481926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2027b9dba2044d9fa9f4ebaf61db04e1', 'request_id': 'req-812f4b6e-f88c-4e99-b53f-be81847c3d98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:16.567423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2027b9dba2044d9fa9f4ebaf61db04e1', 'request_id': 'req-812f4b6e-f88c-4e99-b53f-be81847c3d98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:16.573960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2027b9dba2044d9fa9f4ebaf61db04e1', 'request_id': 'req-812f4b6e-f88c-4e99-b53f-be81847c3d98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:16.608783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] The token cache is being invalidate because project 2027b9dba2044d9fa9f4ebaf61db04e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:16.611141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:16.612659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-812f4b6e-f88c-4e99-b53f-be81847c3d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:16.615377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 883/1750] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:16 2022] DELETE /identity/v3/projects/2027b9dba2044d9fa9f4ebaf61db04e1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:16.619118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:16.635421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0763bde-c735-474f-9c9c-739434bd5f92 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:16.832211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:16.840731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:16.846393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:16.846868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] PATH_INFO: `/v3/users/aac89c7f9b7f412a92c6f47374fcd2a8` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:16.849405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac89c7f9b7f412a92c6f47374fcd2a8)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:16.853986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:17.166179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da42d-95f3-410b-adfb-61514e5844ad None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:17.170636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da42d-95f3-410b-adfb-61514e5844ad None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:17.171455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da42d-95f3-410b-adfb-61514e5844ad None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:17.171657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac89c7f9b7f412a92c6f47374fcd2a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:17.174849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac89c7f9b7f412a92c6f47374fcd2a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:17.177662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 884/1751] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:16:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:16:17.207579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac89c7f9b7f412a92c6f47374fcd2a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:17.208364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac89c7f9b7f412a92c6f47374fcd2a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:17.227885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:17.228795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:17.229409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:17.272120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:17.273600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:17.320272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac89c7f9b7f412a92c6f47374fcd2a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:17.343349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 868/1752] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:16 2022] DELETE /identity/v3/users/aac89c7f9b7f412a92c6f47374fcd2a8 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:17.383807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 885/1753] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:16:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 04 18:16:17.453599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:17.455134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:17.537277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08c7dc-53c4-4b17-b171-55fb778d64d0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:17.542713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e02db-5de1-4262-8b78-36bd7cf4415d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:17.543431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e02db-5de1-4262-8b78-36bd7cf4415d service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:17.543790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e02db-5de1-4262-8b78-36bd7cf4415d service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:17.544081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e02db-5de1-4262-8b78-36bd7cf4415d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:17.553094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e02db-5de1-4262-8b78-36bd7cf4415d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:17.554843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e02db-5de1-4262-8b78-36bd7cf4415d service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:17.566025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 869/1754] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:17.661569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:17.663066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:17.693198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064928e9-ac48-4225-8d05-eefe9a80f7f6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:17.704928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:17.705485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:17.706365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:17.769312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] MFA Rules not processed for user `994dc4b8b3e047ddbe501ff74f3c709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:17.769312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:17.833238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:17.834490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:17.834959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:17.835676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] PATH_INFO: `/v3/projects/176aacd5faa443a78167c6ef29abf256` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:17.837155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176aacd5faa443a78167c6ef29abf256)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:17.839625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:17.904455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 870/1755] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:18.062880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176aacd5faa443a78167c6ef29abf256', 'request_id': 'req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.105490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:18.106896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:18.124900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e02a-4bea-4100-ad46-9ce4a1b535a5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:18.161216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176aacd5faa443a78167c6ef29abf256', 'request_id': 'req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.168095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176aacd5faa443a78167c6ef29abf256', 'request_id': 'req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.203943 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] The token cache is being invalidate because project 176aacd5faa443a78167c6ef29abf256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:18.204497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.205405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.219461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 886/1756] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:17 2022] DELETE /identity/v3/projects/176aacd5faa443a78167c6ef29abf256 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:18.223840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:18.225666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:18.286869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:18.288217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:18.288781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:18.289170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] PATH_INFO: `/v3/projects/ac58d0758f264c038bd6c9005f5efac3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:18.290831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac58d0758f264c038bd6c9005f5efac3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:18.295155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:18.305606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14d18-7b4c-40d5-93ab-b2ea4d11f409 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:18.311568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:18.312841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:18.313508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:18.314087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] PATH_INFO: `/v3/users/fc77fa1afac24b94acdb390067ffa8c8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:18.316477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc77fa1afac24b94acdb390067ffa8c8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:18.318629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:18.452005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac58d0758f264c038bd6c9005f5efac3', 'request_id': 'req-e1210852-b5ce-4ec0-9f94-192d08c9eff6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.557730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc77fa1afac24b94acdb390067ffa8c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.567160 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac58d0758f264c038bd6c9005f5efac3', 'request_id': 'req-e1210852-b5ce-4ec0-9f94-192d08c9eff6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.574154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac58d0758f264c038bd6c9005f5efac3', 'request_id': 'req-e1210852-b5ce-4ec0-9f94-192d08c9eff6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.580721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc77fa1afac24b94acdb390067ffa8c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.580721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc77fa1afac24b94acdb390067ffa8c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.580721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc77fa1afac24b94acdb390067ffa8c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.609054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] The token cache is being invalidate because project ac58d0758f264c038bd6c9005f5efac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:18.609468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.610337 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e1210852-b5ce-4ec0-9f94-192d08c9eff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.616642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 871/1757] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:18 2022] DELETE /identity/v3/projects/ac58d0758f264c038bd6c9005f5efac3 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:18.620808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:18.621367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:18.622144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:18.649721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:18.651163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:18.688200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8aefa6ad-3f0f-4a4b-b61e-a2a97d99aea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc77fa1afac24b94acdb390067ffa8c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:18.718294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 887/1758] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:18 2022] DELETE /identity/v3/users/fc77fa1afac24b94acdb390067ffa8c8 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:18.776495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 872/1759] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:18.790389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:18.790971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:18.795779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:18.835559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:18.837370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:18.937961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 888/1760] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:18.938950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:18.965772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c77eb6-32ba-4f94-b647-71cb4b29fa9e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:18.981651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:18.986737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:18.986737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:18.986737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:18.986737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:18.986737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:18.988717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:19.044444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 873/1761] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:19.048275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:19.060407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987a51-6fcb-4d08-949b-eed7661cbb44 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:19.089191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:19.089191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:19.089191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:19.089191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:19.089807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:19.097833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:19.317617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 889/1762] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:19 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:19.322473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:19.335859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d992-19a8-440a-a3c7-77b496bff082 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:19.487398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:19.499935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:19.500304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:19.500598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:19.501442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:19.503895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:19.583665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:19.585489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:19.626459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459e37f-d4d5-4dca-a6b0-a5877b48e165 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:19.643158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:19.644508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:19.644955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 874/1763] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:19 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:19.645053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:19.645136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] PATH_INFO: `/v3/projects/ad9c78862ca044cdad121243951e321a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:19.648117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:19.651399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9c78862ca044cdad121243951e321a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:19.654193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:19.678244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b70697-bb5c-47ce-990e-542aa22f2849 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:19.697270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:19.697270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:19.697270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:19.697270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:19.697607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:19.697607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:19.728618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 875/1764] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:19.729843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:19.742907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d0b1e-a651-4b03-a409-9cde07548b04 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:19.751010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:19.752384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:19.753027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:19.753554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:19.754358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:19.756186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:19.773901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 876/1765] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:19.787977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:19.848644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133689d-07b7-47c5-9335-362b203b4561 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:19.864625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9c78862ca044cdad121243951e321a', 'request_id': 'req-89e6d18a-dbf4-4f69-900d-6932deaf683e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:19.951978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838d9fc-6c0a-40dc-8de6-4b5bbcd9b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:19.953055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d9fc-6c0a-40dc-8de6-4b5bbcd9b5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:19.953633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d9fc-6c0a-40dc-8de6-4b5bbcd9b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:19.955212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d9fc-6c0a-40dc-8de6-4b5bbcd9b5ec admin admin] PATH_INFO: `/v3/projects/6556580f4a4d412bb6ead88614bf82c1/users/6ccef824f644462fb8df5ae746a00a86/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:19.980492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838d9fc-6c0a-40dc-8de6-4b5bbcd9b5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6556580f4a4d412bb6ead88614bf82c1, user_id=6ccef824f644462fb8df5ae746a00a86, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:19.985133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9c78862ca044cdad121243951e321a', 'request_id': 'req-89e6d18a-dbf4-4f69-900d-6932deaf683e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:19.985935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838d9fc-6c0a-40dc-8de6-4b5bbcd9b5ec admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.004820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9c78862ca044cdad121243951e321a', 'request_id': 'req-89e6d18a-dbf4-4f69-900d-6932deaf683e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:20.062956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] The token cache is being invalidate because project ad9c78862ca044cdad121243951e321a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:20.065172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:20.066764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89e6d18a-dbf4-4f69-900d-6932deaf683e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:20.070393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 890/1766] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:19 2022] DELETE /identity/v3/projects/ad9c78862ca044cdad121243951e321a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:20.076083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028344d-66a6-4ebe-8f78-52e41187e0b7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.079650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028344d-66a6-4ebe-8f78-52e41187e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.079650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028344d-66a6-4ebe-8f78-52e41187e0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.107955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 877/1767] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:19 2022] PUT /identity/v3/projects/6556580f4a4d412bb6ead88614bf82c1/users/6ccef824f644462fb8df5ae746a00a86/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:20.118760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.119168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.120071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.127444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a028344d-66a6-4ebe-8f78-52e41187e0b7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:20.129447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a028344d-66a6-4ebe-8f78-52e41187e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:20.193081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] MFA Rules not processed for user `6ccef824f644462fb8df5ae746a00a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:20.194358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:20.283946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 891/1768] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:20.295518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.297501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.298470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.323384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 878/1769] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:20.325347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.327151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:20.338761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:20.352927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:20.373901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 892/1770] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:20.377218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79861c9d-6d13-46fc-9c4d-0f4c96cc38ab None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.378292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.390243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81752c-e28d-4957-b45c-6b7efc3f70b0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.392288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.392288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.392523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.392800 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.393681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.395969 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.396747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.397740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.398174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.398625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.399741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:20.400197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.402321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.416985 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 893/1771] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:20.422232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.433369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623917-1abc-40c7-b520-8c2ffcefa4b6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.464820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.465530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.465821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.466098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.467255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.469831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.528948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 879/1772] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:20.529899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.566202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 894/1773] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:20.572329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.677810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635275-f4bc-4106-9db2-30d716bdfb2c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.729686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed8e3-29dc-445a-8ee3-43f79b347389 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.738237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.738237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.738237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.738237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.739141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.741253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.883986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.884582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 895/1774] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:20.884687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.884687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.884687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.886363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.893377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.904329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.928959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf370a-73c9-435a-9af0-69b124409afc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.941185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.941970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.942350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.942718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.946493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.948246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:20.971345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 896/1775] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:20.975510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:20.986961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1cde-7fe4-4ccf-b82f-f7c484977217 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:20.992477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:20.993558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:20.994039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:20.994153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:20.994914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:20.997793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.010136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 897/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:21.016285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.028393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3e2e-17c2-4b53-9e4e-709bcea011dd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.034030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958144b4-2604-409d-abd2-217f1a3293f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.034951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958144b4-2604-409d-abd2-217f1a3293f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.035310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958144b4-2604-409d-abd2-217f1a3293f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.042174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958144b4-2604-409d-abd2-217f1a3293f4 admin admin] PATH_INFO: `/v3/projects/309e85b6455a493a82f537c04dd8b319/users/5056254e926a4adfb979de79f26b2811/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.050772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958144b4-2604-409d-abd2-217f1a3293f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309e85b6455a493a82f537c04dd8b319, user_id=5056254e926a4adfb979de79f26b2811, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.053479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958144b4-2604-409d-abd2-217f1a3293f4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.070333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 880/1777] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:20 2022] POST /identity/v3/users => generated 297 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:21.075604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.085574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ace5-4570-4a5a-bebd-2b410d7a70ab admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.091133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.091797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.092128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.092445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.093136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.094769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.105086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 881/1778] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:21.109674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.122251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3b72-250e-4964-a626-4808eb4bbc4e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.127111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 898/1779] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:21 2022] PUT /identity/v3/projects/309e85b6455a493a82f537c04dd8b319/users/5056254e926a4adfb979de79f26b2811/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:21.139719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.140311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.140664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.182363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] MFA Rules not processed for user `5056254e926a4adfb979de79f26b2811`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:21.191115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:21.193652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.194562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.194850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.195476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] PATH_INFO: `/v3/projects/c699f7b435f344a7a430efe9a2ef6db5/users/440fee586743444781ca29e5b9f4916d/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.214278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c699f7b435f344a7a430efe9a2ef6db5, user_id=440fee586743444781ca29e5b9f4916d, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.218684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.290926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 899/1780] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:21.291869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.303748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ccb85-0525-41f9-88bf-25cc0e1ac8d9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.304620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 882/1781] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:21 2022] PUT /identity/v3/projects/c699f7b435f344a7a430efe9a2ef6db5/users/440fee586743444781ca29e5b9f4916d/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:21.310413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.369149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.369868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.370350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.370787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.372398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.374488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.393939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16000-ec20-42be-a2fe-6eb17fa4fee7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.398676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.399446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.399730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.400007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.400738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.402881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.416296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 883/1782] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:21.421210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.433112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8d11-16bd-41c7-abf6-d5dabf9b5989 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.438756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87b35e-b4e1-41db-a361-ff14882911d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.439693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87b35e-b4e1-41db-a361-ff14882911d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.439974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87b35e-b4e1-41db-a361-ff14882911d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.440249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87b35e-b4e1-41db-a361-ff14882911d7 admin admin] PATH_INFO: `/v3/projects/c699f7b435f344a7a430efe9a2ef6db5/users/440fee586743444781ca29e5b9f4916d/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.442301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87b35e-b4e1-41db-a361-ff14882911d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c699f7b435f344a7a430efe9a2ef6db5, user_id=440fee586743444781ca29e5b9f4916d, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.445138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87b35e-b4e1-41db-a361-ff14882911d7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.457858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 884/1783] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:21 2022] PUT /identity/v3/projects/c699f7b435f344a7a430efe9a2ef6db5/users/440fee586743444781ca29e5b9f4916d/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:21.468096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.468466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.468757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.502624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] MFA Rules not processed for user `440fee586743444781ca29e5b9f4916d`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:21.503820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:21.535878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 900/1784] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:21 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:21.540380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.594311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 885/1785] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:21.608179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.610227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:21.624452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d661-970f-47e1-a5d8-8f3252dc3eca admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.630455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.631228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.631516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.631819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.633012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.639036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.691986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a418f9-1f90-4b7f-8132-6b88f137fa89 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.712419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 901/1786] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:21 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:21.718208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.736737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13c17-6632-4c9c-b47e-4bdafdab07c8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.741755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.742440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.742724 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.743020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.743764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.745396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.757711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 902/1787] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:21.757963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.758925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.759044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.759367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.762496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.773033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb308f85-7a0a-4956-bc3a-bba0cd98cb8f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:21.778685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:21.779646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:21.779937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:21.780222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] PATH_INFO: `/v3/projects/bca71e3d2b42493681f0cd558a6f45fa/users/dfe5c44c84cf4f4291d00ebc5d831044/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:21.804671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca71e3d2b42493681f0cd558a6f45fa, user_id=dfe5c44c84cf4f4291d00ebc5d831044, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.807958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.846260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:21.847763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:21.870243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 886/1788] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:21.936372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 903/1789] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:21 2022] PUT /identity/v3/projects/bca71e3d2b42493681f0cd558a6f45fa/users/dfe5c44c84cf4f4291d00ebc5d831044/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:21.937646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:21.950718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040a7c-d372-460a-b690-c330c11be350 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:22.017820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:22.018512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:22.018817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:22.019406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:22.020160 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:22.022152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:22.041620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 887/1790] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:22.044190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:22.055584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975645f-b581-4b09-bfbf-92877afd4f85 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:22.086331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:22.100661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46458-8c81-4e2d-9948-26011dd0525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:22.102325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46458-8c81-4e2d-9948-26011dd0525a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:22.102906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46458-8c81-4e2d-9948-26011dd0525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:22.109342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46458-8c81-4e2d-9948-26011dd0525a admin admin] PATH_INFO: `/v3/projects/bca71e3d2b42493681f0cd558a6f45fa/users/dfe5c44c84cf4f4291d00ebc5d831044/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:22.109342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46458-8c81-4e2d-9948-26011dd0525a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca71e3d2b42493681f0cd558a6f45fa, user_id=dfe5c44c84cf4f4291d00ebc5d831044, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:22.128132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46458-8c81-4e2d-9948-26011dd0525a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:22.206955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 904/1791] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:22 2022] PUT /identity/v3/projects/bca71e3d2b42493681f0cd558a6f45fa/users/dfe5c44c84cf4f4291d00ebc5d831044/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:22.219637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:22.219963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:22.220884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:22.234510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7cdfc-6170-40cd-bf0c-bd259746919e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:22.334622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] MFA Rules not processed for user `dfe5c44c84cf4f4291d00ebc5d831044`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:22.342454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:22.387972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:22.389011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:22.389975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:22.390429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:22.564899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 905/1792] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:22.578426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:22.579925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:22.592609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 888/1793] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:22.625607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:22.628139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:22.657050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fafe53-8469-4c37-9074-bd1c2454a4c5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:22.659214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:22.660383 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:22.660999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:22.661303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:22.758472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:22.760435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:22.771587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 906/1794] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:24.814228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:24.982181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9204c1-de33-4984-b903-92000ad59a6a service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:25.000019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:25.002036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:25.002036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:25.002036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] PATH_INFO: `/v3/users/6ccef824f644462fb8df5ae746a00a86` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:25.008720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccef824f644462fb8df5ae746a00a86)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:25.012686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:25.017474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:25.021191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:25.040160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2e6b-5e98-4d31-b9ee-8715e627c617 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:25.051905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:25.051905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:25.051905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:25.064178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] PATH_INFO: `/v3/users/0d24495e2b76479f814b87967e2b2665` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:25.067515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d24495e2b76479f814b87967e2b2665)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:25.069458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:25.513997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d24495e2b76479f814b87967e2b2665'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.519038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccef824f644462fb8df5ae746a00a86'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.527741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccef824f644462fb8df5ae746a00a86'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.541296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d24495e2b76479f814b87967e2b2665'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.542527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d24495e2b76479f814b87967e2b2665'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.543606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d24495e2b76479f814b87967e2b2665'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.559758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccef824f644462fb8df5ae746a00a86'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.563031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccef824f644462fb8df5ae746a00a86'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.618778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-94a80805-060d-4f77-886d-a5f8f91a0f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d24495e2b76479f814b87967e2b2665'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.638486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 907/1795] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:25 2022] DELETE /identity/v3/users/0d24495e2b76479f814b87967e2b2665 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:25.647529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:25.648077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:25.648516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:25.669727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:25.672028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:25.744633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7e988564-bfaa-47c7-91a5-8f5e6dcbfd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccef824f644462fb8df5ae746a00a86'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:25.751026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 908/1796] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:25.758487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:25.760045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:25.794387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 889/1797] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:24 2022] DELETE /identity/v3/users/6ccef824f644462fb8df5ae746a00a86 => generated 0 bytes in 986 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:25.798977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efa84-02cf-4588-958b-7600830eae8d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:25.799435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efa84-02cf-4588-958b-7600830eae8d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:25.799725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efa84-02cf-4588-958b-7600830eae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:25.829852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb502683-4ad0-4f11-92ac-41104192ffef None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:25.833667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-829efa84-02cf-4588-958b-7600830eae8d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:25.845828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-829efa84-02cf-4588-958b-7600830eae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:25.884639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef6390-30a4-44cc-b250-e529f908a197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:25.885489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6390-30a4-44cc-b250-e529f908a197 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:25.885865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6390-30a4-44cc-b250-e529f908a197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:25.886241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6390-30a4-44cc-b250-e529f908a197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:25.925227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 890/1798] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:25.932015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efa84-02cf-4588-958b-7600830eae8d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:25.943998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efa84-02cf-4588-958b-7600830eae8d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:25.947773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b307b-6448-4a20-a593-63dba7d0feb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:25.952756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b307b-6448-4a20-a593-63dba7d0feb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:25.952756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b307b-6448-4a20-a593-63dba7d0feb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:25.952756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b307b-6448-4a20-a593-63dba7d0feb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:25.958183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6390-30a4-44cc-b250-e529f908a197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:25.958350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b307b-6448-4a20-a593-63dba7d0feb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:25.959700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6390-30a4-44cc-b250-e529f908a197 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:25.959835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b307b-6448-4a20-a593-63dba7d0feb1 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:25.971054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 891/1799] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:25.971647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 909/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:26.581700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269c152-eed8-4931-94fd-b79166714890 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:26.582168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269c152-eed8-4931-94fd-b79166714890 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:26.582566 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269c152-eed8-4931-94fd-b79166714890 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:26.585080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 892/1801] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:16:26.742918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:26.743542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:26.743542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:26.786864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:26.788823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:26.893703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 910/1802] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:26.925930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269c152-eed8-4931-94fd-b79166714890 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:26.927908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b269c152-eed8-4931-94fd-b79166714890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:26.948473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269c152-eed8-4931-94fd-b79166714890 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:26.957036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:26.957956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:26.958313 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:26.958664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:26.969619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:26.971367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:26.985568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 893/1803] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:27.013269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:27.014952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:27.044664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e49414-659b-4fc9-9f1c-319961673af9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:27.050307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:27.051322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:27.051490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:27.051966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] PATH_INFO: `/v3/projects/2611aa9f7b1146d298abadbd97abb946` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:27.054483 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2611aa9f7b1146d298abadbd97abb946)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:27.056581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:27.061733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:27.065165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:27.099151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8a2-5954-4ed9-a1da-a8866e4ee668 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:27.117866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:27.119080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:27.130093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:27.130093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] PATH_INFO: `/v3/projects/6556580f4a4d412bb6ead88614bf82c1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:27.130093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6556580f4a4d412bb6ead88614bf82c1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:27.130093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:27.249565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2611aa9f7b1146d298abadbd97abb946', 'request_id': 'req-27d77571-10c6-46fa-b228-00bcaa142de9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.291633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6556580f4a4d412bb6ead88614bf82c1', 'request_id': 'req-89dfdfb8-acf4-4c63-870c-27af66847f24'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.333640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2611aa9f7b1146d298abadbd97abb946', 'request_id': 'req-27d77571-10c6-46fa-b228-00bcaa142de9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.343753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2611aa9f7b1146d298abadbd97abb946', 'request_id': 'req-27d77571-10c6-46fa-b228-00bcaa142de9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.367415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] The token cache is being invalidate because project 2611aa9f7b1146d298abadbd97abb946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:27.376139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.376139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.376139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 911/1804] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:27 2022] DELETE /identity/v3/projects/2611aa9f7b1146d298abadbd97abb946 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:27.387301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:27.389372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:27.395628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6556580f4a4d412bb6ead88614bf82c1', 'request_id': 'req-89dfdfb8-acf4-4c63-870c-27af66847f24'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.403874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6556580f4a4d412bb6ead88614bf82c1', 'request_id': 'req-89dfdfb8-acf4-4c63-870c-27af66847f24'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.420100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] The token cache is being invalidate because project 6556580f4a4d412bb6ead88614bf82c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:27.420774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.421736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.425754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 894/1805] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:27 2022] DELETE /identity/v3/projects/6556580f4a4d412bb6ead88614bf82c1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:27.429536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:27.432482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:27.482189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77571-10c6-46fa-b228-00bcaa142de9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:27.566110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdfb8-acf4-4c63-870c-27af66847f24 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:27.573591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:27.576082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:27.576546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:27.576978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] PATH_INFO: `/v3/users/440fee586743444781ca29e5b9f4916d` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:27.579327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=440fee586743444781ca29e5b9f4916d)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:27.581303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:27.583555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:27.584701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:27.585132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:27.585826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] PATH_INFO: `/v3/users/a904543f1af94d18ba0d87088abf59ba` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:27.588528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a904543f1af94d18ba0d87088abf59ba)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:27.598235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:27.894039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440fee586743444781ca29e5b9f4916d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.897616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440fee586743444781ca29e5b9f4916d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.913525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a904543f1af94d18ba0d87088abf59ba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.937839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440fee586743444781ca29e5b9f4916d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.938729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440fee586743444781ca29e5b9f4916d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.947825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a904543f1af94d18ba0d87088abf59ba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.950415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a904543f1af94d18ba0d87088abf59ba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:27.950415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a904543f1af94d18ba0d87088abf59ba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:28.051879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440fee586743444781ca29e5b9f4916d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:28.089098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 895/1806] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:27 2022] DELETE /identity/v3/users/440fee586743444781ca29e5b9f4916d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:28.148693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a904543f1af94d18ba0d87088abf59ba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:28.170855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 912/1807] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:27 2022] DELETE /identity/v3/users/a904543f1af94d18ba0d87088abf59ba => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:28.987811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:28.989203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:29.069683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c172b4-1054-4e98-88b3-ff61b1f2f27c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:29.140849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:29.141794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.142085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.142366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] PATH_INFO: `/v3/projects/1ec77bdb647e47949780fb3c66c54025` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.143669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec77bdb647e47949780fb3c66c54025)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:29.147470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:29.270784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:29.272362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:29.291447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45288258-39de-48b4-a973-c341e419a3aa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:29.292816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:29.293902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.294651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.295221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] PATH_INFO: `/v3/projects/c699f7b435f344a7a430efe9a2ef6db5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.297260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c699f7b435f344a7a430efe9a2ef6db5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:29.300005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:29.403805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec77bdb647e47949780fb3c66c54025', 'request_id': 'req-bacd13c7-1e20-4c17-a7f2-2116bff463ef'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.491069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec77bdb647e47949780fb3c66c54025', 'request_id': 'req-bacd13c7-1e20-4c17-a7f2-2116bff463ef'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.498575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec77bdb647e47949780fb3c66c54025', 'request_id': 'req-bacd13c7-1e20-4c17-a7f2-2116bff463ef'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.510362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] The token cache is being invalidate because project 1ec77bdb647e47949780fb3c66c54025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:29.510894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.512277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-bacd13c7-1e20-4c17-a7f2-2116bff463ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.514497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 896/1808] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:28 2022] DELETE /identity/v3/projects/1ec77bdb647e47949780fb3c66c54025 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:29.519270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6c41e-abcf-4061-8a67-b4f48829129a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.519721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6c41e-abcf-4061-8a67-b4f48829129a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.520126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6c41e-abcf-4061-8a67-b4f48829129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.540910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c7b6c41e-abcf-4061-8a67-b4f48829129a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:29.542373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c7b6c41e-abcf-4061-8a67-b4f48829129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:29.563954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c699f7b435f344a7a430efe9a2ef6db5', 'request_id': 'req-906edc41-2510-4c67-9e97-a6645e5d37fc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.610368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 897/1809] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:29.617716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c699f7b435f344a7a430efe9a2ef6db5', 'request_id': 'req-906edc41-2510-4c67-9e97-a6645e5d37fc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.618322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.618621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.618905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.624474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c699f7b435f344a7a430efe9a2ef6db5', 'request_id': 'req-906edc41-2510-4c67-9e97-a6645e5d37fc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.637153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] The token cache is being invalidate because project c699f7b435f344a7a430efe9a2ef6db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:29.637321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.638153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-906edc41-2510-4c67-9e97-a6645e5d37fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:29.640242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 913/1810] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:29 2022] DELETE /identity/v3/projects/c699f7b435f344a7a430efe9a2ef6db5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:29.642604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:29.644011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:29.645024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0dfa8-edfe-44a1-9382-6473485b5b77 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.646496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0dfa8-edfe-44a1-9382-6473485b5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.646496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0dfa8-edfe-44a1-9382-6473485b5b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.665644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e5c0dfa8-edfe-44a1-9382-6473485b5b77 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:29.692549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e5c0dfa8-edfe-44a1-9382-6473485b5b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:29.735421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 898/1811] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:29.736525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:29.745134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac52121-241c-4d56-9f34-5fb24fb8df50 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:29.752829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:29.752829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.752829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.753178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 914/1812] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:29.753272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.753272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:29.753272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:29.754592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:29.763464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.764262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.764749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.768591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 899/1813] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:16:29.774030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:29.784423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052d2d-8259-4204-ad8c-56ea57bab7f7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:29.786203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:29.788575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:29.790621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:29.791321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.791661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.791887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.793134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:29.795091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:29.798102 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 915/1814] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:29.802865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:29.812621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e678b1-2a6d-442e-8445-b9a507fbffd2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:29.817505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:29.817921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.818649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.818649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.819373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:29.820443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:29.822048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:29.839604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 916/1815] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:16:29.841083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:29.854550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0de43-85c2-45ce-b6db-786f213465a6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:29.891156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:29.891156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:29.891156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:29.891156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:29.891852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:29.891852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:30.488944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 900/1816] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:29 2022] POST /identity/v3/projects => generated 373 bytes in 715 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:30.495082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:30.593936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 917/1817] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:29 2022] POST /identity/v3/projects => generated 377 bytes in 753 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:30.596380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29576-f01f-4f55-882a-6ae1a4e8386e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:30.599555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:30.703150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:30.704776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:30.705304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:30.705811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:30.706716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:30.709111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:30.750592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03d3aa-a048-4ae7-868b-74e26d7b8829 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:30.772162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:30.773837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:30.774130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:30.774414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:30.778297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:30.789201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:30.848235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 901/1818] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:30 2022] POST /identity/v3/users => generated 287 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:30.852278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:30.883984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 918/1819] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:30 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:30.897721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:30.899096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e64b6b-75fc-44b7-8f99-c1d1dff0b150 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:30.923335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d2cc-9e3e-4f4f-bfcd-39a871f49b89 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:30.923495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:30.926498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:30.927557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:30.927557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:30.928791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:30.931605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:30.945514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:30.947227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:30.947542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:30.947692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:30.965802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 902/1820] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:30.967955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:30.970658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:30.971164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:30.997788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 919/1821] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:30.999508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.002965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7191e5-202e-4a68-875b-9797cb6744cf admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.008878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.010413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.011440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.011958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.015599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7822-7b5a-4035-9d49-dbd9d40706b6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.021704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.022589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.023696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.023885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.024167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.024915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.027828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.039802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.050768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 920/1822] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:31.059598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.073792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137291-3b28-4eb1-9fce-af9d9855aaa6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.079497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ea4b1-1db0-46f1-92f3-4b5fb1a74b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.080560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ea4b1-1db0-46f1-92f3-4b5fb1a74b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.080913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ea4b1-1db0-46f1-92f3-4b5fb1a74b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.081468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ea4b1-1db0-46f1-92f3-4b5fb1a74b4b admin admin] PATH_INFO: `/v3/projects/bf89a8f64c2e444d9ef994d8b87054cd/users/96d0656fe7a84111bec86403df224856/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.083035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 903/1823] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:31.086794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.105873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ea4b1-1db0-46f1-92f3-4b5fb1a74b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf89a8f64c2e444d9ef994d8b87054cd, user_id=96d0656fe7a84111bec86403df224856, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.110417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3fe2-9949-44f2-9794-bd2abbf4c21c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.116268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ea4b1-1db0-46f1-92f3-4b5fb1a74b4b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.119588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa384d-d42f-462d-9cf7-f56edfa6ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.120821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa384d-d42f-462d-9cf7-f56edfa6ea05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.121333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa384d-d42f-462d-9cf7-f56edfa6ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.121848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa384d-d42f-462d-9cf7-f56edfa6ea05 admin admin] PATH_INFO: `/v3/projects/8c434c9342844504905ac8135aed10d1/users/f26d589516b24804b1c6dbaa01ee9e62/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.153099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa384d-d42f-462d-9cf7-f56edfa6ea05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c434c9342844504905ac8135aed10d1, user_id=f26d589516b24804b1c6dbaa01ee9e62, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.156377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa384d-d42f-462d-9cf7-f56edfa6ea05 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.255831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 921/1824] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:31 2022] PUT /identity/v3/projects/bf89a8f64c2e444d9ef994d8b87054cd/users/96d0656fe7a84111bec86403df224856/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:31.258100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.258209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.258481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.286522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 904/1825] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:31 2022] PUT /identity/v3/projects/8c434c9342844504905ac8135aed10d1/users/f26d589516b24804b1c6dbaa01ee9e62/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:31.288546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.289001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.289432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.312869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] MFA Rules not processed for user `96d0656fe7a84111bec86403df224856`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:31.314191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:31.349593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] MFA Rules not processed for user `f26d589516b24804b1c6dbaa01ee9e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:31.350820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:31.445318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 922/1826] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:31.450463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.465785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 905/1827] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:31.470233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.551139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431c01a-5770-4c71-9360-b22666efe199 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.560084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.560837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.561074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.561352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.562201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.564234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.574710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a8114-1962-41f5-bb37-5547278b8b8a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.580747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.581360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.581808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.582353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.583274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.585364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.690229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 923/1828] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:31 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:31.694509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.741177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 906/1829] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:31 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:31.742220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.788923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad85b69-8456-4832-9417-6c0e1cdfec9d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.834882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641077-caee-4da8-9de2-2302423f3edc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.839875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.840706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.840999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.841278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.841981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.843963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.865396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.866119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.866406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.866733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.867507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.870088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.963438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 907/1830] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:31 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:31.964391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 924/1831] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:31 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:31.964612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.968430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:31.974356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9340fd0-1cbf-4428-8e6e-fe20b643505c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.978418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3e0b-2e9b-4ce9-8ce2-986c0d62c313 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:31.979091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.980607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.980906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.981193 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.982083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.983732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.984164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:31.984871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:31.985234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:31.985536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:31.986459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:31.988224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:31.994383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 908/1832] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:31.999319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 925/1833] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:32.005678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.008299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.013023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd472c-577a-4b30-b69b-e7b7e25175cd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.018019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.018913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.019229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc24e06-9aaa-4acf-ac36-e579e227a590 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.019348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.019511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] PATH_INFO: `/v3/projects/d115972623f247339d8d9d6fb4eb2573/users/15b5d9e4d2654296958c00ba73cc3509/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.024201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.028706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.028706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.028706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.028706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.028706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.036060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d115972623f247339d8d9d6fb4eb2573, user_id=15b5d9e4d2654296958c00ba73cc3509, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.038783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.042581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 926/1834] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:32.043687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.053071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bdd0c-2bc4-4f6a-94c7-40c5020d39d7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.058626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af394cf4-a8d4-4799-be57-eb086f578cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.059531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394cf4-a8d4-4799-be57-eb086f578cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.059816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394cf4-a8d4-4799-be57-eb086f578cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.060100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394cf4-a8d4-4799-be57-eb086f578cce admin admin] PATH_INFO: `/v3/projects/b47ce4787a9a452e8066fce2018cbdfc/users/43b11c783e6d4a4b90fbd2afaddab638/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.077582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af394cf4-a8d4-4799-be57-eb086f578cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47ce4787a9a452e8066fce2018cbdfc, user_id=43b11c783e6d4a4b90fbd2afaddab638, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.080505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af394cf4-a8d4-4799-be57-eb086f578cce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.139604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 909/1835] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:31 2022] PUT /identity/v3/projects/d115972623f247339d8d9d6fb4eb2573/users/15b5d9e4d2654296958c00ba73cc3509/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:32.143706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.216391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 927/1836] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:32 2022] PUT /identity/v3/projects/b47ce4787a9a452e8066fce2018cbdfc/users/43b11c783e6d4a4b90fbd2afaddab638/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:32.217811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2ef5-cbb6-4309-9125-494187f4b6f5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.217919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.218191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.218544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.244472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] MFA Rules not processed for user `43b11c783e6d4a4b90fbd2afaddab638`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:32.246392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:32.277634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.278308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.278595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.278873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.279637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.281243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.291309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 910/1837] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:32.296645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.307597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8104b-38f7-4dd9-9f88-73e7ce36d9f1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.310409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 928/1838] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:32.313989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c705d38-742f-4bb4-82d3-1c5a4caf52aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.314815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c705d38-742f-4bb4-82d3-1c5a4caf52aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.315176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c705d38-742f-4bb4-82d3-1c5a4caf52aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.315457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c705d38-742f-4bb4-82d3-1c5a4caf52aa admin admin] PATH_INFO: `/v3/projects/d115972623f247339d8d9d6fb4eb2573/users/15b5d9e4d2654296958c00ba73cc3509/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.315653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.317677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c705d38-742f-4bb4-82d3-1c5a4caf52aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d115972623f247339d8d9d6fb4eb2573, user_id=15b5d9e4d2654296958c00ba73cc3509, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.320650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c705d38-742f-4bb4-82d3-1c5a4caf52aa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.327281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b756b-1e97-4927-b7ee-d5a392e5a04d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.332920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 911/1839] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:32 2022] PUT /identity/v3/projects/d115972623f247339d8d9d6fb4eb2573/users/15b5d9e4d2654296958c00ba73cc3509/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:32.343408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.343686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.344475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.375642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] MFA Rules not processed for user `15b5d9e4d2654296958c00ba73cc3509`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:32.376976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:32.395471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.396145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.396438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.396718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.397410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.399456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.446895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 912/1840] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:32.461345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.463255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:32.528892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 929/1841] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:32 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:32.530875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.534119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908f01-98d8-466e-afd8-0c36072fa2c1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.600422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64387fe-1a0c-4440-ba86-37e01c644759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.601172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64387fe-1a0c-4440-ba86-37e01c644759 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.601553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64387fe-1a0c-4440-ba86-37e01c644759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.601741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64387fe-1a0c-4440-ba86-37e01c644759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.615196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46ad30-2493-46e2-b209-d7d875268b12 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.621503 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.622710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.623379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.623842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.627709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.631609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.687559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64387fe-1a0c-4440-ba86-37e01c644759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.689010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64387fe-1a0c-4440-ba86-37e01c644759 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.699476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 913/1842] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:32.701929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd479-c5f2-4a56-a63d-c8ca2641a795 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.702233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd479-c5f2-4a56-a63d-c8ca2641a795 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.702498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd479-c5f2-4a56-a63d-c8ca2641a795 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.703814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 914/1843] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:16:32.714812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.714812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.714812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.731323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:32.732552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:32.740865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 930/1844] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:32 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:32.744582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.757391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd47c96-a58e-4d98-b547-dc05a4d813e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.768506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.769193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.769563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.769873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.770625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.772285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.796213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 931/1845] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:32.798064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.809532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589ff8-f44d-4fb6-b215-57f398aacca5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.818366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 915/1846] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:16:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:32.820390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.823192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.823192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.823192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] PATH_INFO: `/v3/projects/115e53b8f5bc4cb296252bbacbccea18/users/c591fbf95af04c64b8e313acba8efe91/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.845144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115e53b8f5bc4cb296252bbacbccea18, user_id=c591fbf95af04c64b8e313acba8efe91, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.848159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.853705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.857405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:32.873378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f1e95-a84c-4782-a76c-9796c2d47a75 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:32.882535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:32.883275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:32.883561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:32.883916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:32.895637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:32.897316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:32.909182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 916/1847] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:32.972857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 932/1848] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:32 2022] PUT /identity/v3/projects/115e53b8f5bc4cb296252bbacbccea18/users/c591fbf95af04c64b8e313acba8efe91/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:32.977475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:32.988522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ac6cb-8942-44ba-ae35-89c3c1d592a7 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:33.065332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d43c0-36a7-4499-ba42-1bcd244c196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:33.066925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d43c0-36a7-4499-ba42-1bcd244c196f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:33.067571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d43c0-36a7-4499-ba42-1bcd244c196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:33.068072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d43c0-36a7-4499-ba42-1bcd244c196f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:33.068987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d43c0-36a7-4499-ba42-1bcd244c196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:33.070738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d43c0-36a7-4499-ba42-1bcd244c196f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:33.090529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 917/1849] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:33.099225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:33.109945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0a6b-d625-4ba0-be25-1b1d4944af25 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:33.116388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:33.117274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:33.117559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:33.117835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] PATH_INFO: `/v3/projects/115e53b8f5bc4cb296252bbacbccea18/users/c591fbf95af04c64b8e313acba8efe91/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:33.119933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=115e53b8f5bc4cb296252bbacbccea18, user_id=c591fbf95af04c64b8e313acba8efe91, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:33.122829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:33.133458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 933/1850] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:33 2022] PUT /identity/v3/projects/115e53b8f5bc4cb296252bbacbccea18/users/c591fbf95af04c64b8e313acba8efe91/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:33.144542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:33.144821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:33.147038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:33.163934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:33.184083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] MFA Rules not processed for user `c591fbf95af04c64b8e313acba8efe91`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:33.185475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:33.237098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674240c5-48b6-408d-b620-e64cfe80b3ab admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:33.241037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:33.241675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:33.242018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:33.242368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:33.244123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:33.271569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 918/1851] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:33.319227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:33.326172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:33.329150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:33.330729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:33.351849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83a000-607a-4921-a791-b74e4f230083 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:33.357458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa77f5-84f9-43ef-a34c-23fdb7b1c962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:33.358133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa77f5-84f9-43ef-a34c-23fdb7b1c962 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:33.358463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa77f5-84f9-43ef-a34c-23fdb7b1c962 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:33.358745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa77f5-84f9-43ef-a34c-23fdb7b1c962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:33.359818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 934/1852] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:33.466225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa77f5-84f9-43ef-a34c-23fdb7b1c962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:33.468056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa77f5-84f9-43ef-a34c-23fdb7b1c962 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:33.482128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 919/1853] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:34.837410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:34.902738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee757-e215-42d7-b607-eeaed3ca57b2 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:34.908456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:34.909909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:34.910196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:34.910799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] PATH_INFO: `/v3/users/f26d589516b24804b1c6dbaa01ee9e62` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:34.912034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26d589516b24804b1c6dbaa01ee9e62)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:34.914046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:35.144395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26d589516b24804b1c6dbaa01ee9e62'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:35.159391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26d589516b24804b1c6dbaa01ee9e62'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:35.160119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26d589516b24804b1c6dbaa01ee9e62'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:35.170842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26d589516b24804b1c6dbaa01ee9e62'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:35.325716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26d589516b24804b1c6dbaa01ee9e62'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:35.338809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 935/1854] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:34 2022] DELETE /identity/v3/users/f26d589516b24804b1c6dbaa01ee9e62 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:35.344005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:35.344441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:35.345359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:35.363607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:35.364930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:35.423026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 920/1855] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:35.432558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:35.434591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:35.496100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf3cfb-e574-479e-a78c-a19b9c4ee6c5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:35.500051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:35.500819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:35.501104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:35.501606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:35.514233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:35.518161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:35.525590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 936/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:36.068615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:36.070064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:36.083083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a25f2-7eb2-48fc-8b8b-81caf45ca770 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:36.087870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:36.089439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:36.089814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:36.090318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] PATH_INFO: `/v3/projects/8c434c9342844504905ac8135aed10d1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:36.091572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c434c9342844504905ac8135aed10d1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:36.093490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:36.205045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c434c9342844504905ac8135aed10d1', 'request_id': 'req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.295675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c434c9342844504905ac8135aed10d1', 'request_id': 'req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.302308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c434c9342844504905ac8135aed10d1', 'request_id': 'req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.315605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] The token cache is being invalidate because project 8c434c9342844504905ac8135aed10d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:36.315928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.316558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.320942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 921/1857] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:36 2022] DELETE /identity/v3/projects/8c434c9342844504905ac8135aed10d1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:36.322473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:36.335996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ea7e7-b293-455b-8f06-bc3578859336 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:36.403941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:36.404824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:36.405642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:36.405642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] PATH_INFO: `/v3/users/15b5d9e4d2654296958c00ba73cc3509` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:36.406832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b5d9e4d2654296958c00ba73cc3509)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:36.411458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:36.625510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b5d9e4d2654296958c00ba73cc3509'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.639216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b5d9e4d2654296958c00ba73cc3509'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.639216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b5d9e4d2654296958c00ba73cc3509'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.639579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b5d9e4d2654296958c00ba73cc3509'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.708551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b5d9e4d2654296958c00ba73cc3509'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:36.721595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 937/1858] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:36 2022] DELETE /identity/v3/users/15b5d9e4d2654296958c00ba73cc3509 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:37.225295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:37.226709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:37.289061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199cd73-2b8b-410c-bbf0-916dc2fe3bb4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:37.339692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:37.340346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:37.340630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:37.340921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:37.342731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:37.400994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:37.402643 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d3be1-241e-4ffb-9797-22b5766dc811 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:37.412041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 922/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:37.440994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:37.443244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:37.528810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f30f-7394-4f18-8b3f-20b8127d6cac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:37.536204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:37.538587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:37.538874 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:37.539190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] PATH_INFO: `/v3/projects/d115972623f247339d8d9d6fb4eb2573` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:37.540733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d115972623f247339d8d9d6fb4eb2573)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:37.543738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:37.676602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd115972623f247339d8d9d6fb4eb2573', 'request_id': 'req-f024f185-5474-413b-a5a0-6c4024dc463b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:37.766608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd115972623f247339d8d9d6fb4eb2573', 'request_id': 'req-f024f185-5474-413b-a5a0-6c4024dc463b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:37.772375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd115972623f247339d8d9d6fb4eb2573', 'request_id': 'req-f024f185-5474-413b-a5a0-6c4024dc463b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:37.785798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] The token cache is being invalidate because project d115972623f247339d8d9d6fb4eb2573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:37.786174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:37.786848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f024f185-5474-413b-a5a0-6c4024dc463b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:37.788570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 938/1860] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:37 2022] DELETE /identity/v3/projects/d115972623f247339d8d9d6fb4eb2573 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:37.794625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:37.794918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:37.795231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:37.815091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:37.815091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:37.887473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 923/1861] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:37.897070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:37.897547 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:37.897837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:37.923694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:37.924961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:37.937159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 939/1862] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:37.938894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:37.948891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413d45-649b-4aac-ab73-5a9bc3c0e6b7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:37.955268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:37.955983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:37.956270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:37.956551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:37.957297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:37.957874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:37.959920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:37.974024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 924/1863] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:37.978254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:37.989190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0a874-8955-43f3-b5f9-0dfe2bcc7867 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:37.996093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:37.996760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:37.997041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:37.997315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:37.998019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.000034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:38.120814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 940/1864] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:37 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:38.122105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:38.132635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a975b6-2905-42ac-be9b-3de569c5bdb7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:38.190617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:38.191395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.191621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.191899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.192615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.194565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:38.306591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 925/1865] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:38 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:38.311624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:38.322903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291864a-9250-43b9-be5b-5da68c611f84 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:38.328359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:38.329109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.329460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.329824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.330754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.332564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:38.354628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 941/1866] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:38.355600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:38.368623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da326-9cf0-48cf-a467-79404ab5fbfc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:38.382674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1eb5-a139-41d0-ad0d-d5eb20d5badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:38.383492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1eb5-a139-41d0-ad0d-d5eb20d5badf admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.383878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1eb5-a139-41d0-ad0d-d5eb20d5badf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.384190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1eb5-a139-41d0-ad0d-d5eb20d5badf admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.384995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de1eb5-a139-41d0-ad0d-d5eb20d5badf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.389345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de1eb5-a139-41d0-ad0d-d5eb20d5badf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:38.401646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 926/1867] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:38.406528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:38.418732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447083-29f6-4a5e-be80-5f23681637bd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:38.424502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:38.425542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.425838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.426123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] PATH_INFO: `/v3/projects/5a29291d72ad467fb53caf673dd39e7d/users/6d4d203efcf8485580be267704fecce9/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.444021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a29291d72ad467fb53caf673dd39e7d, user_id=6d4d203efcf8485580be267704fecce9, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.446880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:38.560618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 942/1868] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:38 2022] PUT /identity/v3/projects/5a29291d72ad467fb53caf673dd39e7d/users/6d4d203efcf8485580be267704fecce9/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:38.572109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.572404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.572680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.603465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] MFA Rules not processed for user `6d4d203efcf8485580be267704fecce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:38.604969 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:38.674728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 927/1869] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:38.679254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:38.741036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbdad-2f32-4f7b-802b-e648765f29db admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:38.746431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:38.747129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.747417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.747694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.748386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.750299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:38.841769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 943/1870] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:38 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:38.845837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:38.857052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5403-03b0-4568-b5d2-51995ba65436 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:38.911189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:38.911852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:38.912131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:38.912431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:38.913126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:38.915047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.023466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 928/1871] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:38 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:39.028441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:39.038862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cf54-cedc-4883-8ec3-24fa8148381d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:39.043556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:39.044273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.044562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.044847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.045626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:39.047269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.059353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 944/1872] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:39.063845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:39.074540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6843100-14f6-4a39-8b99-d867b60315cc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:39.079389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:39.080292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.080570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.080845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] PATH_INFO: `/v3/projects/10d54c4cde4f481a9a91b1f3262c2304/users/52d349ccbbcf48feb11f2f9355c4d2df/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.096700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d54c4cde4f481a9a91b1f3262c2304, user_id=52d349ccbbcf48feb11f2f9355c4d2df, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:39.099397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.188497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 929/1873] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:39 2022] PUT /identity/v3/projects/10d54c4cde4f481a9a91b1f3262c2304/users/52d349ccbbcf48feb11f2f9355c4d2df/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:39.192482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:39.207041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf88c4-d672-4b81-9c21-c0f2b73a0843 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:39.261226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e35d06-7f9b-4eb2-98ff-71329f9f9977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:39.261815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35d06-7f9b-4eb2-98ff-71329f9f9977 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.262094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35d06-7f9b-4eb2-98ff-71329f9f9977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.262367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35d06-7f9b-4eb2-98ff-71329f9f9977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.263398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e35d06-7f9b-4eb2-98ff-71329f9f9977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:39.265462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e35d06-7f9b-4eb2-98ff-71329f9f9977 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.275342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 945/1874] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:39.279842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:39.290098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bc3e8-a2d3-439d-92ce-2be537f349a8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:39.295417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:39.296317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.296604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.296882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] PATH_INFO: `/v3/projects/10d54c4cde4f481a9a91b1f3262c2304/users/52d349ccbbcf48feb11f2f9355c4d2df/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.298843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d54c4cde4f481a9a91b1f3262c2304, user_id=52d349ccbbcf48feb11f2f9355c4d2df, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:39.301525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.312598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 930/1875] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:39 2022] PUT /identity/v3/projects/10d54c4cde4f481a9a91b1f3262c2304/users/52d349ccbbcf48feb11f2f9355c4d2df/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:39.324178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.324590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.324880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.351198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] MFA Rules not processed for user `52d349ccbbcf48feb11f2f9355c4d2df`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:39.352416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:39.419682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 946/1876] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:39.430111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:39.431802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:39.488241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a837-1440-4e50-8cea-a6aecab04966 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:39.492018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:39.492665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.492950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.493220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.503047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:39.504477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.514800 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 931/1877] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:39.613929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:39.623481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd012-d2ec-4256-b6f2-d1347da342d0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:39.627073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:39.627722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:39.628003 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:39.628278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:39.694683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:39.696141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:39.705770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 947/1878] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:40.673503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:40.682211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82015837-54bb-4e9b-8181-79277399f860 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:40.688686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:40.689359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:40.692905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:40.692905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:40.693123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:40.765491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:40.766858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:40.778190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 932/1879] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:49.285752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:49.287292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:49.358071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f9804-126f-472a-bdf2-71d48be4d235 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:49.362660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:49.363562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:49.363843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:49.364114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] PATH_INFO: `/v3/users/5056254e926a4adfb979de79f26b2811` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:49.365284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5056254e926a4adfb979de79f26b2811)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:49.367222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:49.508824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5056254e926a4adfb979de79f26b2811'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.523881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5056254e926a4adfb979de79f26b2811'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.524635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5056254e926a4adfb979de79f26b2811'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.525307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5056254e926a4adfb979de79f26b2811'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.609201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1d590636-9da4-40e3-a2b5-5732c6f4614f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5056254e926a4adfb979de79f26b2811'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.609453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:49.621225 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e753963-1cb0-43c1-958d-46015951a0c4 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:49.623119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 948/1880] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:49 2022] DELETE /identity/v3/users/5056254e926a4adfb979de79f26b2811 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:49.627827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:49.628116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:49.628391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:49.647608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:49.649029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:49.688953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:49.690132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:49.693497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:49.693497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] PATH_INFO: `/v3/users/6d4d203efcf8485580be267704fecce9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:49.693497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4d203efcf8485580be267704fecce9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:49.693736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:49.710811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 949/1881] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:49.720698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:49.722120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:49.778590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5f61a-cafb-4664-bf19-5492b9416408 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:49.782756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af50b69-47c2-4a8e-83b5-ff990e90138f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:49.783461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af50b69-47c2-4a8e-83b5-ff990e90138f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:49.783748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af50b69-47c2-4a8e-83b5-ff990e90138f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:49.784018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af50b69-47c2-4a8e-83b5-ff990e90138f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:49.794773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af50b69-47c2-4a8e-83b5-ff990e90138f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:49.796421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af50b69-47c2-4a8e-83b5-ff990e90138f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:49.807303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 950/1882] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:16:49.949421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4d203efcf8485580be267704fecce9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.950152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4d203efcf8485580be267704fecce9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.962498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4d203efcf8485580be267704fecce9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:49.963409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4d203efcf8485580be267704fecce9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.051952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4d203efcf8485580be267704fecce9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.069342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 933/1883] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:49 2022] DELETE /identity/v3/users/6d4d203efcf8485580be267704fecce9 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:50.074546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:50.075160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:50.075444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:50.093189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:50.094410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:50.163842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 951/1884] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:50.174207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:50.175826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:50.238528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1d9e3-7f8f-4c5c-a7fe-83bb2c62a037 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:50.242312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:50.243135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:50.243500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:50.243842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:50.254173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:50.255821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:50.266697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 934/1885] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:50.349232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:50.350797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:50.362752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73145e4a-32b9-41f5-9fb6-a0f9dadaad7a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:50.368138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:50.369764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:50.370058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:50.370465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] PATH_INFO: `/v3/projects/309e85b6455a493a82f537c04dd8b319` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:50.381374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] RBAC: Authorizing `identity:delete_project(project_id=309e85b6455a493a82f537c04dd8b319)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:50.393180 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:50.533952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309e85b6455a493a82f537c04dd8b319', 'request_id': 'req-f96c3fa6-1868-49ad-939f-107bf8a7224c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.616156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309e85b6455a493a82f537c04dd8b319', 'request_id': 'req-f96c3fa6-1868-49ad-939f-107bf8a7224c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.625080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309e85b6455a493a82f537c04dd8b319', 'request_id': 'req-f96c3fa6-1868-49ad-939f-107bf8a7224c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.640234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] The token cache is being invalidate because project 309e85b6455a493a82f537c04dd8b319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:50.640562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.641319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:50.643237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 952/1886] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:50 2022] DELETE /identity/v3/projects/309e85b6455a493a82f537c04dd8b319 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:50.647123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:50.658741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abee3-8c13-4e08-beb2-272bfc6a9a5a service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:50.760308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:50.761189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:50.761470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:50.761743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] PATH_INFO: `/v3/users/dfe5c44c84cf4f4291d00ebc5d831044` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:50.763505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe5c44c84cf4f4291d00ebc5d831044)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:50.765583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:50.806216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:50.807816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:50.836162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3fa6-1868-49ad-939f-107bf8a7224c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:50.851823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:50.854706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:50.855044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:50.855348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] PATH_INFO: `/v3/projects/5a29291d72ad467fb53caf673dd39e7d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:50.858098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a29291d72ad467fb53caf673dd39e7d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:50.865632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:51.022314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe5c44c84cf4f4291d00ebc5d831044'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.023302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe5c44c84cf4f4291d00ebc5d831044'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.032384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a29291d72ad467fb53caf673dd39e7d', 'request_id': 'req-d4411271-4474-42f5-a723-5f7504231e82'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.055821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe5c44c84cf4f4291d00ebc5d831044'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.057358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe5c44c84cf4f4291d00ebc5d831044'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.130704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a29291d72ad467fb53caf673dd39e7d', 'request_id': 'req-d4411271-4474-42f5-a723-5f7504231e82'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.138338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a29291d72ad467fb53caf673dd39e7d', 'request_id': 'req-d4411271-4474-42f5-a723-5f7504231e82'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.149444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] The token cache is being invalidate because project 5a29291d72ad467fb53caf673dd39e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:51.149748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.151059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.155664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 953/1887] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:50 2022] DELETE /identity/v3/projects/5a29291d72ad467fb53caf673dd39e7d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:51.156829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:51.158265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:51.236218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411271-4474-42f5-a723-5f7504231e82 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:51.238610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe5c44c84cf4f4291d00ebc5d831044'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.248530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:51.249614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:51.250449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:51.251052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] PATH_INFO: `/v3/users/52d349ccbbcf48feb11f2f9355c4d2df` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:51.254196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d349ccbbcf48feb11f2f9355c4d2df)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:51.256168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:51.262357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 935/1888] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:50 2022] DELETE /identity/v3/users/dfe5c44c84cf4f4291d00ebc5d831044 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:51.496017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d349ccbbcf48feb11f2f9355c4d2df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.513584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d349ccbbcf48feb11f2f9355c4d2df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.514492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d349ccbbcf48feb11f2f9355c4d2df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.515711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d349ccbbcf48feb11f2f9355c4d2df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.633244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d349ccbbcf48feb11f2f9355c4d2df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:51.649926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 954/1889] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:51 2022] DELETE /identity/v3/users/52d349ccbbcf48feb11f2f9355c4d2df => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:52.029738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.031563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:52.125526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2ed74-01ca-4068-b54c-bb6aeb562168 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.188581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.189454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.189742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.190025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] PATH_INFO: `/v3/projects/bca71e3d2b42493681f0cd558a6f45fa` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.191248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca71e3d2b42493681f0cd558a6f45fa)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.194412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.237093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.238698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:52.254484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e5bcd-7d49-410b-a66a-9d3952e3e900 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.259181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.260470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.260755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.261035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] PATH_INFO: `/v3/projects/10d54c4cde4f481a9a91b1f3262c2304` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.262509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d54c4cde4f481a9a91b1f3262c2304)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.264466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.365273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca71e3d2b42493681f0cd558a6f45fa', 'request_id': 'req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.434283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d54c4cde4f481a9a91b1f3262c2304', 'request_id': 'req-c8d16c4b-527b-4740-990f-97ad0552156c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.443946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca71e3d2b42493681f0cd558a6f45fa', 'request_id': 'req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.455471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca71e3d2b42493681f0cd558a6f45fa', 'request_id': 'req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.468987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] The token cache is being invalidate because project bca71e3d2b42493681f0cd558a6f45fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:52.469277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.469948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2b383ea2-307a-4ce3-b8e1-ce3b842a888f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.471681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 936/1890] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:52 2022] DELETE /identity/v3/projects/bca71e3d2b42493681f0cd558a6f45fa => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:52.477502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4f99e-ef7d-4a82-a37b-8a2ba46e2dce None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.477790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4f99e-ef7d-4a82-a37b-8a2ba46e2dce None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.478138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4f99e-ef7d-4a82-a37b-8a2ba46e2dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.498934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1da4f99e-ef7d-4a82-a37b-8a2ba46e2dce None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:52.500617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1da4f99e-ef7d-4a82-a37b-8a2ba46e2dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:52.535023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d54c4cde4f481a9a91b1f3262c2304', 'request_id': 'req-c8d16c4b-527b-4740-990f-97ad0552156c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.545379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d54c4cde4f481a9a91b1f3262c2304', 'request_id': 'req-c8d16c4b-527b-4740-990f-97ad0552156c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.558882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] The token cache is being invalidate because project 10d54c4cde4f481a9a91b1f3262c2304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:52.559213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.560045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c8d16c4b-527b-4740-990f-97ad0552156c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:52.561800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 955/1891] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:52 2022] DELETE /identity/v3/projects/10d54c4cde4f481a9a91b1f3262c2304 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:52.566782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1db96-6b62-4ced-8a52-bfb744b67ad2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.567244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1db96-6b62-4ced-8a52-bfb744b67ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.567396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1db96-6b62-4ced-8a52-bfb744b67ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.573204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 937/1892] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:52.581833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.582130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.582424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.586406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-46f1db96-6b62-4ced-8a52-bfb744b67ad2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:52.588269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-46f1db96-6b62-4ced-8a52-bfb744b67ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:52.596894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 956/1893] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:52.602441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:52.604214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:52.605068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.611088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.611088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.613191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 938/1894] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:52.617818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.625689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:52.626947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:52.632722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e52ba-a87f-49cc-9176-6ff4655c9efd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.638794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.639528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.639839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.640121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.641127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:52.641377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.643319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.646465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 957/1895] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:52.651882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.660993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 939/1896] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:16:52.665148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa1aec-e65e-4ca7-9216-f38f928779cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.665733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.670626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.671579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.671742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.671937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.672666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:52.672977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.674781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.676520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dce3d-4f02-4218-88a9-ed4dcc1fc85a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.682478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.683181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.683467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.683744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.684438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.686351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.695084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 958/1897] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:16:52.699792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.710650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02dfbf-4f24-49f1-9c20-af4e284ccc4c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.716445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.717240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.717622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.718031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.718831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.721242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.782125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 940/1898] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:52.786694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.851110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 959/1899] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:52.856369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:52.868765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370f30-dccd-49c4-a5af-3bbae69d306a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.946865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c902cb-498b-4c79-9c61-264f803a7d0f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:52.952647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.953390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.953508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:52.953685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.953986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.954856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.955494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:52.955931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:52.956953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:52.957085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:52.958840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:52.961183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.023593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 960/1900] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:53.025290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 941/1901] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:52 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:53.028560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.029691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.042074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10f99-d2ce-4e52-9e6c-16e8127de888 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.043320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445072d1-5157-4818-aad1-793c9a20b5ac admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.053931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.054276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.054382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.054382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.054382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.054600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.054600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.054600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.054850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.054931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.055037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.055134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.065658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 942/1902] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:53.069961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.080888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 961/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:53.082384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.088436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0fdd-2b45-4cc2-abcd-a884b6e18fe2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.094380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.095087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.095377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.095657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.096384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.098102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.102094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7d0a-7105-4b03-a2d6-a75cb884fb5d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.108525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.109213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.109500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.109782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.110719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 943/1904] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:16:53.111445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.113240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.114758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.128673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 962/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:53.128777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91fcd-fbb0-4ea2-a207-106f23a771be admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.134285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.134285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.134617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.134617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.134617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.134617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] PATH_INFO: `/v3/projects/f7b35137cc9a4b53a03cb881ae62e8b0/users/336b8fe726dd4909a1421b5bc9092dd4/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.144952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b429edb-0772-47f8-92d1-032a84e400ca admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.150017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.150169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b35137cc9a4b53a03cb881ae62e8b0, user_id=336b8fe726dd4909a1421b5bc9092dd4, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.151116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.151406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.153983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] PATH_INFO: `/v3/users/96d0656fe7a84111bec86403df224856` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.153983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d0656fe7a84111bec86403df224856)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.154165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.154817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.233575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 944/1906] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:53 2022] PUT /identity/v3/projects/f7b35137cc9a4b53a03cb881ae62e8b0/users/336b8fe726dd4909a1421b5bc9092dd4/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:53.240667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.295257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5f9dd-11a3-452e-94ee-d55581be6fdb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.300169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974384-cc20-4d44-80d6-1024b13b1948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.301063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974384-cc20-4d44-80d6-1024b13b1948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.301349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974384-cc20-4d44-80d6-1024b13b1948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.301636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974384-cc20-4d44-80d6-1024b13b1948 admin admin] PATH_INFO: `/v3/projects/9a222386d13f480a8a2f66f522d724ab/users/f434666bc4504d389fd9a214082f7e4e/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.316946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0974384-cc20-4d44-80d6-1024b13b1948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a222386d13f480a8a2f66f522d724ab, user_id=f434666bc4504d389fd9a214082f7e4e, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.319691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0974384-cc20-4d44-80d6-1024b13b1948 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.338446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d0656fe7a84111bec86403df224856'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:53.350390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d0656fe7a84111bec86403df224856'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:53.351941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d0656fe7a84111bec86403df224856'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:53.352555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d0656fe7a84111bec86403df224856'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:53.387569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 945/1907] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:53 2022] PUT /identity/v3/projects/9a222386d13f480a8a2f66f522d724ab/users/f434666bc4504d389fd9a214082f7e4e/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:53.388904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674f34f-9fe2-4c4c-bcc7-7967e37cfac2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.389194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674f34f-9fe2-4c4c-bcc7-7967e37cfac2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.389502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674f34f-9fe2-4c4c-bcc7-7967e37cfac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.417180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1674f34f-9fe2-4c4c-bcc7-7967e37cfac2 None None] MFA Rules not processed for user `336b8fe726dd4909a1421b5bc9092dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:53.418354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1674f34f-9fe2-4c4c-bcc7-7967e37cfac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.444160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea712ffd-f178-4edb-bdda-ecf4081e6722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d0656fe7a84111bec86403df224856'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:53.458055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 963/1908] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:53 2022] DELETE /identity/v3/users/96d0656fe7a84111bec86403df224856 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:53.466387 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.466680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.466957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.502578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] MFA Rules not processed for user `f434666bc4504d389fd9a214082f7e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:53.504981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.508982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 946/1909] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:53.510593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.511173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.511673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.534526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:53.534526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.608784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 964/1910] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:53.612695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.612970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.622452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 947/1911] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:53.623608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.626978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.642750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f097c1-78c1-4dd4-8c71-91c44b821949 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.648205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.648944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.649589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.650092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.651037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.653349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.699328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add601f2-03c3-4a20-b8d5-9e4b1e1eb4c6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.704650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.705354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.705641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.705919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.736562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 948/1912] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:53 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:53.740470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.742346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:53.766177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.767697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.777202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 965/1913] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:53.777992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.788513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef27d-0caf-48e6-a613-6d2c5f2582de service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.802383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3f427-497d-4a14-86eb-a62850b0178f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.806006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.807568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.807910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.808198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.857366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:53.858027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:53.858309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:53.858579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:53.859376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.861257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.905030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:53.906710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:53.918349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 949/1914] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:53.978135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 966/1915] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:53 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:53.982155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:53.992715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8b2a-e31b-4287-81c9-7f1f10366c63 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:53.999829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:54.006788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.006788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.006788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.006788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:54.006788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:54.023398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 950/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:54.028033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:54.039834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365818-911f-45fd-b487-dc9d6e5ac670 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:54.045198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:54.046085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.046366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.046644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] PATH_INFO: `/v3/projects/1465d4e9dba94087a741e58747c28b3d/users/127f38f478004e7ea1adf706603cfdd1/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.065182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1465d4e9dba94087a741e58747c28b3d, user_id=127f38f478004e7ea1adf706603cfdd1, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:54.068653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:54.193550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 967/1917] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:54 2022] PUT /identity/v3/projects/1465d4e9dba94087a741e58747c28b3d/users/127f38f478004e7ea1adf706603cfdd1/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:54.198489 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:54.212410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420421d6-3360-4eb1-a6d5-cd47edc750a8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:54.278432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212206c8-5fa2-4fb6-90a1-eed4f2c635aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:54.279586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212206c8-5fa2-4fb6-90a1-eed4f2c635aa admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.279874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212206c8-5fa2-4fb6-90a1-eed4f2c635aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.280154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212206c8-5fa2-4fb6-90a1-eed4f2c635aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.281262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212206c8-5fa2-4fb6-90a1-eed4f2c635aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:54.283015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212206c8-5fa2-4fb6-90a1-eed4f2c635aa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:54.295414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 951/1918] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:54.299475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:54.312065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5682a-b75f-45e0-b25c-54bf1cac6521 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:54.340669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:54.341594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.343509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.345547 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] PATH_INFO: `/v3/projects/1465d4e9dba94087a741e58747c28b3d/users/127f38f478004e7ea1adf706603cfdd1/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.352000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1465d4e9dba94087a741e58747c28b3d, user_id=127f38f478004e7ea1adf706603cfdd1, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:54.364793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:54.392465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 968/1919] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:54 2022] PUT /identity/v3/projects/1465d4e9dba94087a741e58747c28b3d/users/127f38f478004e7ea1adf706603cfdd1/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:54.403318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.403856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.404324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.436964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] MFA Rules not processed for user `127f38f478004e7ea1adf706603cfdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:54.438483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:54.515772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 952/1920] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:54.581913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:54.624158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:54.625904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:54.640643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d95c2-6b99-4bf5-bfae-07ce309d4d6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:54.645805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:54.647211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.647521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.647804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.659312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:54.660760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:54.671403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 969/1921] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:54.703770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fc3a4-e99e-4f62-93de-2786b89a8e50 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:54.708900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:54.709808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:54.710096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:54.710378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] PATH_INFO: `/v3/projects/bf89a8f64c2e444d9ef994d8b87054cd` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:54.711803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf89a8f64c2e444d9ef994d8b87054cd)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:54.716861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:54.866171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf89a8f64c2e444d9ef994d8b87054cd', 'request_id': 'req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:54.940904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf89a8f64c2e444d9ef994d8b87054cd', 'request_id': 'req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:54.949594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf89a8f64c2e444d9ef994d8b87054cd', 'request_id': 'req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:54.962226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] The token cache is being invalidate because project bf89a8f64c2e444d9ef994d8b87054cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:54.962677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:54.963480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:54.965691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 953/1922] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:54 2022] DELETE /identity/v3/projects/bf89a8f64c2e444d9ef994d8b87054cd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:54.969710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:54.989799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bbf90-0c90-48ae-be2e-c88c45c0c698 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:55.076864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:55.082793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:55.082793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:55.082793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] PATH_INFO: `/v3/users/43b11c783e6d4a4b90fbd2afaddab638` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:55.082793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b11c783e6d4a4b90fbd2afaddab638)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:55.082793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:55.270905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b11c783e6d4a4b90fbd2afaddab638'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:55.283011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b11c783e6d4a4b90fbd2afaddab638'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:55.283866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b11c783e6d4a4b90fbd2afaddab638'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:55.284476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b11c783e6d4a4b90fbd2afaddab638'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:55.392512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b11c783e6d4a4b90fbd2afaddab638'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:55.406828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 970/1923] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:54 2022] DELETE /identity/v3/users/43b11c783e6d4a4b90fbd2afaddab638 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:55.956976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:55.958749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:55.988198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf670b46-bde0-47a8-b5a9-5fb64e2925b5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:56.160934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:56.160934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:56.160934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:56.160934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] PATH_INFO: `/v3/projects/b47ce4787a9a452e8066fce2018cbdfc` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:56.161744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47ce4787a9a452e8066fce2018cbdfc)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:56.161744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:56.312538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47ce4787a9a452e8066fce2018cbdfc', 'request_id': 'req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.473709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:56.475864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:56.489235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7be44-b800-4fa2-907d-b2b4d5dfa93d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:56.531499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47ce4787a9a452e8066fce2018cbdfc', 'request_id': 'req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.538336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47ce4787a9a452e8066fce2018cbdfc', 'request_id': 'req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.566073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] The token cache is being invalidate because project b47ce4787a9a452e8066fce2018cbdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:56.566370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.567046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.571633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 954/1924] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:55 2022] DELETE /identity/v3/projects/b47ce4787a9a452e8066fce2018cbdfc => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:56.573230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:56.575123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:56.601516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:56.603683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:56.604012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:56.604324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] PATH_INFO: `/v3/users/f434666bc4504d389fd9a214082f7e4e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:56.606550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f434666bc4504d389fd9a214082f7e4e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:56.611869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:56.691760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016b84-5fc8-4b0c-88ef-4334bd16d7fa admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:56.696755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:56.697758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:56.698053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:56.698361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] PATH_INFO: `/v3/users/c591fbf95af04c64b8e313acba8efe91` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:56.699631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c591fbf95af04c64b8e313acba8efe91)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:56.701550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:56.844627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f434666bc4504d389fd9a214082f7e4e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.870711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f434666bc4504d389fd9a214082f7e4e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.871605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f434666bc4504d389fd9a214082f7e4e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.880937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f434666bc4504d389fd9a214082f7e4e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.959459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c591fbf95af04c64b8e313acba8efe91'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.965886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c591fbf95af04c64b8e313acba8efe91'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:56.981123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7c97c3f1-c80c-4bab-961a-362192426b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f434666bc4504d389fd9a214082f7e4e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:57.018251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 971/1925] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:56 2022] DELETE /identity/v3/users/f434666bc4504d389fd9a214082f7e4e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:57.026745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:57.027073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:57.027362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:57.035829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c591fbf95af04c64b8e313acba8efe91'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:57.037936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c591fbf95af04c64b8e313acba8efe91'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:57.074502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:57.076210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:57.152912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c591fbf95af04c64b8e313acba8efe91'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:57.170297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 972/1926] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:16:57.172228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 955/1927] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:56 2022] DELETE /identity/v3/users/c591fbf95af04c64b8e313acba8efe91 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:57.184787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:57.184787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:57.278518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6909b-b222-4b0c-9001-ceb8b9a6f6cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:57.349649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:57.350714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:57.351229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:57.351504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:57.454521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:57.455720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:57.479664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 973/1928] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:16:58.175451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:58.180818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:58.217301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cec36-5395-4329-996b-e2ad71db7440 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:58.235633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:58.239439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:58.239726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:58.240006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] PATH_INFO: `/v3/projects/9a222386d13f480a8a2f66f522d724ab` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:58.241575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a222386d13f480a8a2f66f522d724ab)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:58.244248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:58.415819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a222386d13f480a8a2f66f522d724ab', 'request_id': 'req-2902d720-f5db-4bbb-ad8c-bae5d5534fea'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.449470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:58.450971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:58.465548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fefd-e3fd-4d3a-a189-d6ef916bffbd service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:58.504560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a222386d13f480a8a2f66f522d724ab', 'request_id': 'req-2902d720-f5db-4bbb-ad8c-bae5d5534fea'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.516950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a222386d13f480a8a2f66f522d724ab', 'request_id': 'req-2902d720-f5db-4bbb-ad8c-bae5d5534fea'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.565724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] The token cache is being invalidate because project 9a222386d13f480a8a2f66f522d724ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:58.566021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.575535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.577913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 956/1929] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:58 2022] DELETE /identity/v3/projects/9a222386d13f480a8a2f66f522d724ab => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:58.581703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:58.591324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:58.597786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:58.598722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:58.599036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:58.599331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] PATH_INFO: `/v3/projects/115e53b8f5bc4cb296252bbacbccea18` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:58.600757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115e53b8f5bc4cb296252bbacbccea18)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:58.622895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:58.636953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d720-f5db-4bbb-ad8c-bae5d5534fea admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:58.642681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:58.644268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:58.644716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:58.645505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] PATH_INFO: `/v3/users/127f38f478004e7ea1adf706603cfdd1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:58.647432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] RBAC: Authorizing `identity:delete_user(user_id=127f38f478004e7ea1adf706603cfdd1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:58.650326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:58.749865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115e53b8f5bc4cb296252bbacbccea18', 'request_id': 'req-110cea80-2000-4038-b603-7ab4e34795d8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.881405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115e53b8f5bc4cb296252bbacbccea18', 'request_id': 'req-110cea80-2000-4038-b603-7ab4e34795d8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.890914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115e53b8f5bc4cb296252bbacbccea18', 'request_id': 'req-110cea80-2000-4038-b603-7ab4e34795d8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.903930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] The token cache is being invalidate because project 115e53b8f5bc4cb296252bbacbccea18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:16:58.904624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.905348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-110cea80-2000-4038-b603-7ab4e34795d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:58.907262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 974/1930] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:58 2022] DELETE /identity/v3/projects/115e53b8f5bc4cb296252bbacbccea18 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:58.911728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461260-2b5e-4620-8016-940b0c9bf809 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:58.912066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461260-2b5e-4620-8016-940b0c9bf809 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:58.912406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461260-2b5e-4620-8016-940b0c9bf809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:58.932589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2c461260-2b5e-4620-8016-940b0c9bf809 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:58.933884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c461260-2b5e-4620-8016-940b0c9bf809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:59.000133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 975/1931] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:59.008202 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127f38f478004e7ea1adf706603cfdd1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.008535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.009886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.009886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.010744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127f38f478004e7ea1adf706603cfdd1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.028496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127f38f478004e7ea1adf706603cfdd1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.029705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127f38f478004e7ea1adf706603cfdd1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.037342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:59.038834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:59.048843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 976/1932] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:16:59.052955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.063201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c86df-e42c-4c5d-85f3-14a0f3cebfcd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.067794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.068461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.068776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.069055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.069843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:16:59.070157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.072395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.085785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 977/1933] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:16:59.092552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.102376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4140-de36-4d0f-8dd8-17f0bee82f25 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.106447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127f38f478004e7ea1adf706603cfdd1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.110020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.116359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.116359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.116359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.116359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.116359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.121854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 957/1934] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:58 2022] DELETE /identity/v3/users/127f38f478004e7ea1adf706603cfdd1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:59.222613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 978/1935] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:16:59 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:16:59.227039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.319914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed114c-0df9-4f90-86f7-35cce202036a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.403639 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.404328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.404610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.404882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.405607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.407561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.494252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.495087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:59.514050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15f2a-ddfb-4346-be5d-4a896b9b38ec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.520553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 958/1936] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:16:59 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:16:59.521268 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.522492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.523125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.523541 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] PATH_INFO: `/v3/users/336b8fe726dd4909a1421b5bc9092dd4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.528004 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336b8fe726dd4909a1421b5bc9092dd4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.528211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.531920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.544961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d08504-11ca-4de7-bad2-35189dce58c2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.551784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.552601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.552990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.553561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.554671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.557651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.575862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 959/1937] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:59.580601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.592079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4423b-8b59-4c59-8c7b-a7e038aba09e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.597771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.598786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.599269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.600102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.600494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.602337 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.622022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 960/1938] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:16:59.623054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.638683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6255e-e463-474f-9d11-d71f19219193 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:16:59.646458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc413-063b-4afa-a273-1d166b9f5ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:16:59.654550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc413-063b-4afa-a273-1d166b9f5ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.654550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc413-063b-4afa-a273-1d166b9f5ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.654550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc413-063b-4afa-a273-1d166b9f5ff3 admin admin] PATH_INFO: `/v3/projects/ec653f06d26145639a9025236956aeba/users/23ade6455f85466b896d5c9b474d6cb7/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.671833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cc413-063b-4afa-a273-1d166b9f5ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec653f06d26145639a9025236956aeba, user_id=23ade6455f85466b896d5c9b474d6cb7, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:16:59.676870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cc413-063b-4afa-a273-1d166b9f5ff3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:16:59.756061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336b8fe726dd4909a1421b5bc9092dd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.772300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336b8fe726dd4909a1421b5bc9092dd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.773325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336b8fe726dd4909a1421b5bc9092dd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.774346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336b8fe726dd4909a1421b5bc9092dd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.866919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 961/1939] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:16:59 2022] PUT /identity/v3/projects/ec653f06d26145639a9025236956aeba/users/23ade6455f85466b896d5c9b474d6cb7/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:16:59.878675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badcaaa-53b2-4251-b349-a3e97be21c67 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:16:59.879291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badcaaa-53b2-4251-b349-a3e97be21c67 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:16:59.879569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badcaaa-53b2-4251-b349-a3e97be21c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:16:59.895443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336b8fe726dd4909a1421b5bc9092dd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:16:59.913828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4badcaaa-53b2-4251-b349-a3e97be21c67 None None] MFA Rules not processed for user `23ade6455f85466b896d5c9b474d6cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:16:59.915298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4badcaaa-53b2-4251-b349-a3e97be21c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:16:59.918524 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 979/1940] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:16:59 2022] DELETE /identity/v3/users/336b8fe726dd4909a1421b5bc9092dd4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:16:59.919876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:16:59.922415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.016290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 962/1941] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:00.019055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.019353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.019670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.044426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:00.045473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661420-7581-4308-a408-401edf1ee444 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:00.045923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.051545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:00.053606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.059247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.059247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] PATH_INFO: `/v3/projects/1465d4e9dba94087a741e58747c28b3d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.059479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 963/1942] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:00.059479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:00.060612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.060968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1465d4e9dba94087a741e58747c28b3d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:00.068256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:00.167658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532912-05b2-45e2-9a38-40a5055d05f8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:00.171833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:00.172661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.173039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.173437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.184551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:00.186099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:00.196657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 964/1943] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:00.197678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:00.199301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.244695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1465d4e9dba94087a741e58747c28b3d', 'request_id': 'req-209f9311-42ab-4406-b50e-bb76b0ed79fd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:00.302132 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527b1e1-7ebf-46c8-8e3d-7bd7c5880eb0 service glance] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:00.329150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1465d4e9dba94087a741e58747c28b3d', 'request_id': 'req-209f9311-42ab-4406-b50e-bb76b0ed79fd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:00.340770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1465d4e9dba94087a741e58747c28b3d', 'request_id': 'req-209f9311-42ab-4406-b50e-bb76b0ed79fd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:00.362226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] The token cache is being invalidate because project 1465d4e9dba94087a741e58747c28b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:00.363090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:00.364322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-209f9311-42ab-4406-b50e-bb76b0ed79fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:00.366058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 980/1944] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:16:59 2022] DELETE /identity/v3/projects/1465d4e9dba94087a741e58747c28b3d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:00.371868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.378772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.378772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.380579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:00.381450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.382644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.382854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.385399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.404677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:00.405918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.487950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:00.492490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445fbbe-f3cf-4b93-959f-68d605050ff5 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:00.507588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 965/1945] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:00.514981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 981/1946] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:00.522670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.525173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.525662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.548055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:00.549666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:00.570494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 966/1947] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:00.575832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:00.603580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5140-1366-4c22-b078-b647cb1f2c9f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:00.611634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:00.612887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.613370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.613873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.614861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:00.615747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:00.619073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:00.638121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 982/1948] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:17:00.638319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:00.654007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541b82-6972-4200-90b8-aa3016a0a039 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:00.670050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:00.670741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.671453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.671453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.672034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:00.674055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:00.745666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 967/1949] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:00 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:00.749468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:00.764929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4061f88-9887-4265-8d51-0e07c3705323 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:00.873446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:00.874395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:00.874873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:00.875897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:00.876800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:00.879559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.022172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 983/1950] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:00 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:01.026957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.037312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338459ba-4bb5-4aec-90f4-b9e7393d307f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.045912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.046600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.049569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.049569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.049569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.049845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.060762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 968/1951] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:01.064925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.075249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567393-880a-43fb-a30e-e32c0efcfbe2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.080192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.083719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.084405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.084693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.084978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.085785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.086522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:01.087927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.098794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 984/1952] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:01.107903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.119169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c64ff-335c-44bc-8705-d7994cf4c749 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.119736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89626bd4-afb6-4625-a725-9f0ef2bb4e1a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.124054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.125754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.125754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.125754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] PATH_INFO: `/v3/projects/f7b35137cc9a4b53a03cb881ae62e8b0` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.126661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b35137cc9a4b53a03cb881ae62e8b0)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.128595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.131157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea447-f1c7-4291-ae8a-c73d508c2f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.132099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea447-f1c7-4291-ae8a-c73d508c2f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.132392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea447-f1c7-4291-ae8a-c73d508c2f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.132673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea447-f1c7-4291-ae8a-c73d508c2f83 admin admin] PATH_INFO: `/v3/projects/c99c4efe429b4239861095a01c0b5a6e/users/b325eb3bf49f4d19a3d5fd123c74b439/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.151218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aea447-f1c7-4291-ae8a-c73d508c2f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99c4efe429b4239861095a01c0b5a6e, user_id=b325eb3bf49f4d19a3d5fd123c74b439, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.153982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aea447-f1c7-4291-ae8a-c73d508c2f83 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.250718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 985/1953] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:01 2022] PUT /identity/v3/projects/c99c4efe429b4239861095a01c0b5a6e/users/b325eb3bf49f4d19a3d5fd123c74b439/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:01.261552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.261855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.262137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.294022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b35137cc9a4b53a03cb881ae62e8b0', 'request_id': 'req-034b982b-e633-4876-8e70-0036f3e79617'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:01.334315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] MFA Rules not processed for user `b325eb3bf49f4d19a3d5fd123c74b439`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:01.335756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:01.364056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b35137cc9a4b53a03cb881ae62e8b0', 'request_id': 'req-034b982b-e633-4876-8e70-0036f3e79617'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:01.371107 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b35137cc9a4b53a03cb881ae62e8b0', 'request_id': 'req-034b982b-e633-4876-8e70-0036f3e79617'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:01.385359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] The token cache is being invalidate because project f7b35137cc9a4b53a03cb881ae62e8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:01.385655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:01.386953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034b982b-e633-4876-8e70-0036f3e79617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:01.388706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 969/1954] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:01 2022] DELETE /identity/v3/projects/f7b35137cc9a4b53a03cb881ae62e8b0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:01.393444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4f544-c0b7-4621-8fbc-d514c907e565 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.395858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4f544-c0b7-4621-8fbc-d514c907e565 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.395858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4f544-c0b7-4621-8fbc-d514c907e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.415095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a4c4f544-c0b7-4621-8fbc-d514c907e565 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:01.417153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a4c4f544-c0b7-4621-8fbc-d514c907e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:01.423420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 986/1955] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:01.434854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.439890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:01.505365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 970/1956] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:01.510550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.510839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.511157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.516868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90de0d-d789-4663-b573-125048b097e1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.521782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.523244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.523244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.523244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.530445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:01.531689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:01.533657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.535197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.540529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 971/1957] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:01.544757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.546448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 987/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:17:01.557078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde895-a717-4e62-b0d0-842a84a687df None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.562321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.563282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.563727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.564016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.564844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:01.565158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.566811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.581134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 972/1959] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:17:01.585930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.599594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e02b-b32f-4e07-a40c-63df2c6eba56 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.605258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.605996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.606228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.606505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.607414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.609317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.700061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 988/1960] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:01 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:01.705035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.716526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600fd5-ed13-47e7-aa36-924e39e43e64 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.778298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.784273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.784273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.784273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.784273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.784273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.967200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 973/1961] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:01 2022] POST /identity/v3/users => generated 286 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:01.968444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:01.979418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fe27-c385-4682-9f27-195832212302 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:01.983918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:01.984579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:01.990587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:01.990587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:01.990587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:01.990587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:01.998883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 989/1962] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:02.003248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:02.013759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44b5d-f925-480b-a17b-e4e5903079d6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:02.018875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ff2fb-a94f-4e9d-92f9-1f0ae5ceb998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:02.019606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ff2fb-a94f-4e9d-92f9-1f0ae5ceb998 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:02.019893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ff2fb-a94f-4e9d-92f9-1f0ae5ceb998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:02.020175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ff2fb-a94f-4e9d-92f9-1f0ae5ceb998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:02.020914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ff2fb-a94f-4e9d-92f9-1f0ae5ceb998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:02.022571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ff2fb-a94f-4e9d-92f9-1f0ae5ceb998 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:02.033308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 974/1963] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:02.037574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:02.049225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a013c-b73f-4523-adf4-b15e62b4d732 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:02.054294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:02.059300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:02.059300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:02.059300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] PATH_INFO: `/v3/projects/e62c01738ad54b24ab386c5849e5a80f/users/ab2ef54f713941ceb805a9027f38d78f/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:02.073820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62c01738ad54b24ab386c5849e5a80f, user_id=ab2ef54f713941ceb805a9027f38d78f, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:02.076817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:02.187081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 990/1964] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:02 2022] PUT /identity/v3/projects/e62c01738ad54b24ab386c5849e5a80f/users/ab2ef54f713941ceb805a9027f38d78f/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:02.197739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:02.198283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:02.198823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:02.244604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] MFA Rules not processed for user `ab2ef54f713941ceb805a9027f38d78f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:02.245869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:02.327366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 975/1965] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:02.342379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:02.349212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:02.487869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce6d1-ee3c-49ac-84b4-f6e9f23f04c5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:02.497632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216f39a-e2d1-404b-ae13-0f77ede9c292 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:02.498508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f39a-e2d1-404b-ae13-0f77ede9c292 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:02.498892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f39a-e2d1-404b-ae13-0f77ede9c292 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:02.505475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f39a-e2d1-404b-ae13-0f77ede9c292 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:02.509549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216f39a-e2d1-404b-ae13-0f77ede9c292 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:02.511695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216f39a-e2d1-404b-ae13-0f77ede9c292 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:02.522227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 991/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:15.741929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:15.744379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:15.809003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f858-ba82-4f28-9ba2-9a0e791b2730 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:15.814279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:15.815240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:15.815652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:15.815807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] PATH_INFO: `/v3/users/ff8c7140be0d4fe898fc7c5d0916c6e9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:15.817134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8c7140be0d4fe898fc7c5d0916c6e9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:15.819301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:15.978819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8c7140be0d4fe898fc7c5d0916c6e9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:15.979555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8c7140be0d4fe898fc7c5d0916c6e9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:15.992962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8c7140be0d4fe898fc7c5d0916c6e9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:15.993715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8c7140be0d4fe898fc7c5d0916c6e9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.093582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8c7140be0d4fe898fc7c5d0916c6e9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.108213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 976/1967] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:15 2022] DELETE /identity/v3/users/ff8c7140be0d4fe898fc7c5d0916c6e9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:16.112846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:16.113379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:16.113515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:16.131775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:16.133002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:16.193833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 992/1968] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:16.207668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:16.207668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:16.264341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea347ec6-18f1-4c85-aec2-5e7084627d28 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:16.268400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:16.269078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:16.269358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:16.269699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:16.280124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:16.280974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:16.293270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 977/1969] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:16.690205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:16.691911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:16.705232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43cc8-ea40-4874-93c0-0d5ef471ba27 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:16.710285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:16.711934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:16.712869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:16.713224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] PATH_INFO: `/v3/projects/ec59e7ddf8164929b710290eddb43b83` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:16.714579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec59e7ddf8164929b710290eddb43b83)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:16.716716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:16.865635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec59e7ddf8164929b710290eddb43b83', 'request_id': 'req-1dd7d9e3-51a5-40e6-ba25-bf426712de03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.956795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec59e7ddf8164929b710290eddb43b83', 'request_id': 'req-1dd7d9e3-51a5-40e6-ba25-bf426712de03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.963616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec59e7ddf8164929b710290eddb43b83', 'request_id': 'req-1dd7d9e3-51a5-40e6-ba25-bf426712de03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.974521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] The token cache is being invalidate because project ec59e7ddf8164929b710290eddb43b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:16.974808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.975526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:16.977076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 993/1970] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:16 2022] DELETE /identity/v3/projects/ec59e7ddf8164929b710290eddb43b83 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:16.981521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:16.991474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c1e8-8280-47c4-8d53-8f1d67c28e84 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:17.054182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:17.055361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:17.055799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:17.056141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] PATH_INFO: `/v3/users/8c1fc0b0172c410cabccac616c02fdfd` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:17.057472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1fc0b0172c410cabccac616c02fdfd)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:17.059461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:17.105326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:17.107004 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:17.120739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d9e3-51a5-40e6-ba25-bf426712de03 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:17.125617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:17.126557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:17.126846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:17.127240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] PATH_INFO: `/v3/users/b325eb3bf49f4d19a3d5fd123c74b439` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:17.129196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b325eb3bf49f4d19a3d5fd123c74b439)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:17.130285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:17.220565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1fc0b0172c410cabccac616c02fdfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.221337 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1fc0b0172c410cabccac616c02fdfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.234727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1fc0b0172c410cabccac616c02fdfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.235838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1fc0b0172c410cabccac616c02fdfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.333400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7c9cd5a8-c769-42cb-bf13-99b21ae8b14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1fc0b0172c410cabccac616c02fdfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.346667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 978/1971] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:16 2022] DELETE /identity/v3/users/8c1fc0b0172c410cabccac616c02fdfd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:17.384826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b325eb3bf49f4d19a3d5fd123c74b439'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.397093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b325eb3bf49f4d19a3d5fd123c74b439'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.397836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b325eb3bf49f4d19a3d5fd123c74b439'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.398460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b325eb3bf49f4d19a3d5fd123c74b439'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.494827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b325eb3bf49f4d19a3d5fd123c74b439'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:17.509130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 994/1972] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:17 2022] DELETE /identity/v3/users/b325eb3bf49f4d19a3d5fd123c74b439 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:17.514214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:17.514536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:17.514817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:17.533235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:17.535165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:17.612372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 979/1973] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:17.622863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:17.624552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:17.687136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5338e-2523-450c-a098-2f9bc3b2a050 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:17.691379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff4161-be9c-4e8a-846e-b673e62088c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:17.692154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff4161-be9c-4e8a-846e-b673e62088c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:17.692436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff4161-be9c-4e8a-846e-b673e62088c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:17.692718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff4161-be9c-4e8a-846e-b673e62088c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:17.703415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff4161-be9c-4e8a-846e-b673e62088c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:17.704849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff4161-be9c-4e8a-846e-b673e62088c0 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:17.714882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 995/1974] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:17.838492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:17.843436 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:17.853400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709ff63-8c8c-431d-a3b4-684bbed6494f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:17.859026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:17.860174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:17.860610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:17.861104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] PATH_INFO: `/v3/projects/50cd161930da45fab9f124a1b53bbf65` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:17.862353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cd161930da45fab9f124a1b53bbf65)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:17.864318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:17.988234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cd161930da45fab9f124a1b53bbf65', 'request_id': 'req-5f2317c5-3213-47bd-93f0-84de44d2bc8d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.073474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cd161930da45fab9f124a1b53bbf65', 'request_id': 'req-5f2317c5-3213-47bd-93f0-84de44d2bc8d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.090392 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cd161930da45fab9f124a1b53bbf65', 'request_id': 'req-5f2317c5-3213-47bd-93f0-84de44d2bc8d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.107849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] The token cache is being invalidate because project 50cd161930da45fab9f124a1b53bbf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:18.108139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.108835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5f2317c5-3213-47bd-93f0-84de44d2bc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.110611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 980/1975] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:17 2022] DELETE /identity/v3/projects/50cd161930da45fab9f124a1b53bbf65 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:18.118060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.118341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.118615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.136957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:18.138214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.206865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 996/1976] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:18.215034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.215456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.215787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.235133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:18.236358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.245407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 981/1977] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:18.249851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.260671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cfa08-1017-442a-8b95-c8836b00f892 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.265685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.266349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.266628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.266902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.267679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:18.267984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.269620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.283018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 997/1978] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:17:18.287278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.297106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9feba-e960-42b2-9ae2-aaed57d4b238 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.301788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.302439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.302716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.303009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.303768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.305701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.313439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.315304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.330845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a933506-a446-4734-9c6f-44c11d7c6795 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.339457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.339995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.340285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.340564 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] PATH_INFO: `/v3/projects/c99c4efe429b4239861095a01c0b5a6e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.341899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99c4efe429b4239861095a01c0b5a6e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.344146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.410166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 982/1979] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/projects => generated 355 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:18.414106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.460983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99c4efe429b4239861095a01c0b5a6e', 'request_id': 'req-ea0b37c3-af04-4bfb-8ac8-017f633a6803'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.480113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8928018-d816-4d73-9e4e-534eb87e4b14 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.539618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.540536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.540825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.541104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.541953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.543980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.544955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99c4efe429b4239861095a01c0b5a6e', 'request_id': 'req-ea0b37c3-af04-4bfb-8ac8-017f633a6803'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.551071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99c4efe429b4239861095a01c0b5a6e', 'request_id': 'req-ea0b37c3-af04-4bfb-8ac8-017f633a6803'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.564550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] The token cache is being invalidate because project c99c4efe429b4239861095a01c0b5a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:18.564832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.565588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea0b37c3-af04-4bfb-8ac8-017f633a6803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:18.567728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 998/1980] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:18 2022] DELETE /identity/v3/projects/c99c4efe429b4239861095a01c0b5a6e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:18.575166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345e21-b77a-47b7-b0a2-e7f74c73b73e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.575456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345e21-b77a-47b7-b0a2-e7f74c73b73e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.575736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345e21-b77a-47b7-b0a2-e7f74c73b73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.594594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-57345e21-b77a-47b7-b0a2-e7f74c73b73e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:18.595855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-57345e21-b77a-47b7-b0a2-e7f74c73b73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.604731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 999/1981] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:18.614731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.615053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.615336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.633013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:18.634702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.639823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 983/1982] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/users => generated 278 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:18.640844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.642372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.643019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1000/1983] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:18.647145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.657490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc5ba6-84d5-454d-bd7d-40e0a097a89e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.659282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897a81b-b87b-4683-81bf-f3af8d24d6bd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.663474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.663934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.664061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.664350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.664615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.664899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.665174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.665585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.665901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.666336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:18.666651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.667659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.668568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.678675 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 984/1984] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:18.681981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1001/1985] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:17:18.683378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.686276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.693750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ac26-6e8c-4426-9044-198257c93c59 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.696846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de1b9-0db4-4c5c-a6cb-66870b33a0fe admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.700664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.701406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.701505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.701690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.701966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.702195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.702422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.702688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.702797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.703414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.704328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.705301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.715309 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 985/1986] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:18.719344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.728874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b4a7-12d7-490e-95f2-f2803c4144ba admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.733401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa5d8-b7b7-497b-ac6a-789d57fe31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.734264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa5d8-b7b7-497b-ac6a-789d57fe31fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.734549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa5d8-b7b7-497b-ac6a-789d57fe31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.734825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa5d8-b7b7-497b-ac6a-789d57fe31fd admin admin] PATH_INFO: `/v3/projects/ee6f72957add4a739d872e570c6e83b7/users/5f12b41dfcfa44a8a247e231a605322e/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.751533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa5d8-b7b7-497b-ac6a-789d57fe31fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6f72957add4a739d872e570c6e83b7, user_id=5f12b41dfcfa44a8a247e231a605322e, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.754250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa5d8-b7b7-497b-ac6a-789d57fe31fd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:18.841928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1002/1987] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:18.843050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:18.879790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 986/1988] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:18 2022] PUT /identity/v3/projects/ee6f72957add4a739d872e570c6e83b7/users/5f12b41dfcfa44a8a247e231a605322e/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:18.891420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.891764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.892052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.912345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b09e4-47ee-4f2a-bff4-5f6591ca64ec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:18.924383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] MFA Rules not processed for user `5f12b41dfcfa44a8a247e231a605322e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:18.925656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:18.975561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:18.976668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:18.976798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:18.977169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:18.977913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:18.979857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.000564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 987/1989] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:19.010841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.021477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dc13e-0d78-4046-a873-079c08a014c0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.027593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.028260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.028543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.028824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.029533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.031492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.053879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1003/1990] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:18 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:19.058696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.072487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a904d5-280d-4090-a91a-aeb4dd4d1583 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.077652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.081561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.081561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.081561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.081561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.081561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.094259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1004/1991] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:19.096976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.107068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 988/1992] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:19 2022] POST /identity/v3/projects => generated 355 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:19.108668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.109000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1040-c371-4906-9853-bd4eaa3d8ec9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.189639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.190502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.190785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.190882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93f60-f3b9-4de4-9a8b-cd8bfa9735d5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.191094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.191819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.193425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.196418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.197601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.197901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.198185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.198891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.200871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.207045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1005/1993] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:19.209620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.220660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b881d-0448-4604-956e-eb0b7004421c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.225399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a921ee-5128-48e5-8a03-daa85137c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.226267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a921ee-5128-48e5-8a03-daa85137c43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.226552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a921ee-5128-48e5-8a03-daa85137c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.226832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a921ee-5128-48e5-8a03-daa85137c43a admin admin] PATH_INFO: `/v3/projects/33e49ba5692240a9b6ced2305b3af73f/users/94f66148172842239c0c793bdbbf7257/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.242157 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a921ee-5128-48e5-8a03-daa85137c43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e49ba5692240a9b6ced2305b3af73f, user_id=94f66148172842239c0c793bdbbf7257, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.246243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a921ee-5128-48e5-8a03-daa85137c43a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.272680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 989/1994] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:19 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:19.277454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.287544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7e29-ae5c-492e-b93d-8372a005c58b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.292300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.292952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.293241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.293521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.294249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.295882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.310654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 990/1995] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:19.311667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.322790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a64f-ec80-47dc-b3da-e51c6e38077a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.327996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.328918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.329204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.329634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] PATH_INFO: `/v3/projects/ebcc1fe0955b4cfabafd6c7982fea397/users/275449c3c157402c95c46e351bc54f94/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.346386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcc1fe0955b4cfabafd6c7982fea397, user_id=275449c3c157402c95c46e351bc54f94, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.349249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.368408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1006/1996] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:19 2022] PUT /identity/v3/projects/33e49ba5692240a9b6ced2305b3af73f/users/94f66148172842239c0c793bdbbf7257/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:19.383894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.384208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.384502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.410557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] MFA Rules not processed for user `94f66148172842239c0c793bdbbf7257`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:19.411805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:19.443776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 991/1997] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:19 2022] PUT /identity/v3/projects/ebcc1fe0955b4cfabafd6c7982fea397/users/275449c3c157402c95c46e351bc54f94/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:19.448253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.480284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1007/1998] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:19.484868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.512717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896119-8920-42c5-9121-f8d2c345820e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.517502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.518210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.518498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.518778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.519564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.521194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.531916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 992/1999] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:19.535677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.545159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4c71-d1e7-485f-bbd8-423d6189f2b7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.548682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec25ae6-215a-4cc3-8e72-73eebf3b4ffa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.549750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2456-1611-45d8-beb6-a3b6ede98c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.550622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2456-1611-45d8-beb6-a3b6ede98c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.550904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2456-1611-45d8-beb6-a3b6ede98c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.551209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2456-1611-45d8-beb6-a3b6ede98c48 admin admin] PATH_INFO: `/v3/projects/ebcc1fe0955b4cfabafd6c7982fea397/users/275449c3c157402c95c46e351bc54f94/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.553139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2456-1611-45d8-beb6-a3b6ede98c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcc1fe0955b4cfabafd6c7982fea397, user_id=275449c3c157402c95c46e351bc54f94, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.553425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.554164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.554445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.554722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.556093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.556533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2456-1611-45d8-beb6-a3b6ede98c48 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.558056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.572168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 993/2000] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:19 2022] PUT /identity/v3/projects/ebcc1fe0955b4cfabafd6c7982fea397/users/275449c3c157402c95c46e351bc54f94/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:19.582283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.582573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.582856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.610013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] MFA Rules not processed for user `275449c3c157402c95c46e351bc54f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:19.611445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:19.664482 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1008/2001] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:19 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:19.665727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.683406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 994/2002] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:19.698734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.698734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:19.734105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8ab5-96dd-4416-ae27-6f6fc6ba7f7d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.738790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.739492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.739774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.740052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.740731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.743180 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.754454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a94e-18e0-42aa-a12b-18866e84de36 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.807303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.807974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.808258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.808731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.819169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1009/2003] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:19 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:19.823917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.834135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e7808-25e3-4021-b826-13b9b9db97b5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.840164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.840842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.841128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.841406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.842135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.843777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.854851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1010/2004] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:19.859140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.868902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe5207-7aa4-4988-b0c8-93a74e29c871 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:19.873216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.873536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:19.874402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:19.874678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:19.874771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.874948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] PATH_INFO: `/v3/projects/d19bc035e96d42d5833f63a1239ad81f/users/50882a901ecd41a5a7c21890b78cb44c/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:19.885211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 995/2005] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:17:19.891740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19bc035e96d42d5833f63a1239ad81f, user_id=50882a901ecd41a5a7c21890b78cb44c, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:19.895412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:19.952376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1011/2006] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:19 2022] PUT /identity/v3/projects/d19bc035e96d42d5833f63a1239ad81f/users/50882a901ecd41a5a7c21890b78cb44c/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:19.956578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:19.968067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803b716-0cc6-414c-804d-b06cda2a0163 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:20.031568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:20.032228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:20.032519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:20.032796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:20.033525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:20.035471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:20.051875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 996/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:20.055824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:20.056374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:20.067028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324baf5-03e6-4bfd-a040-62158dc354d5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:20.072711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb494d46-479d-4c01-b18f-a3c923b5a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:20.073728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494d46-479d-4c01-b18f-a3c923b5a137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:20.074015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494d46-479d-4c01-b18f-a3c923b5a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:20.074956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494d46-479d-4c01-b18f-a3c923b5a137 admin admin] PATH_INFO: `/v3/projects/d19bc035e96d42d5833f63a1239ad81f/users/50882a901ecd41a5a7c21890b78cb44c/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:20.078242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb494d46-479d-4c01-b18f-a3c923b5a137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19bc035e96d42d5833f63a1239ad81f, user_id=50882a901ecd41a5a7c21890b78cb44c, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:20.081156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb494d46-479d-4c01-b18f-a3c923b5a137 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:20.094730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 997/2008] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:20 2022] PUT /identity/v3/projects/d19bc035e96d42d5833f63a1239ad81f/users/50882a901ecd41a5a7c21890b78cb44c/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:20.105102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:20.105620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:20.105910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:20.135890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd0863-a508-4f72-aef9-56ba98481dfd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:20.140468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] MFA Rules not processed for user `50882a901ecd41a5a7c21890b78cb44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:20.144294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:20.220866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:20.221913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:20.222363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:20.222903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:20.247859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 998/2009] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:20.264378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:20.265799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:20.281805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92525-fdba-4c55-91a3-dff19a5a7bfa None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:20.285431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec3b4d-6cd3-4d03-89b3-7153266957f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:20.286070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3b4d-6cd3-4d03-89b3-7153266957f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:20.286356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3b4d-6cd3-4d03-89b3-7153266957f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:20.286649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3b4d-6cd3-4d03-89b3-7153266957f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:20.290188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:20.291680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:20.301721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1012/2010] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:20.354773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec3b4d-6cd3-4d03-89b3-7153266957f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:20.356321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec3b4d-6cd3-4d03-89b3-7153266957f6 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:20.365818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 999/2011] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:17:24.752839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:24.814017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a47d7-85ac-4757-b52b-bc540d2ae5d8 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:24.822271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:24.822271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:24.822271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:24.822271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] PATH_INFO: `/v3/users/94f66148172842239c0c793bdbbf7257` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:24.822670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f66148172842239c0c793bdbbf7257)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:24.823495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:25.065552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f66148172842239c0c793bdbbf7257'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:25.080759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f66148172842239c0c793bdbbf7257'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:25.080759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f66148172842239c0c793bdbbf7257'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:25.080759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f66148172842239c0c793bdbbf7257'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:25.236010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f66148172842239c0c793bdbbf7257'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:25.248847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1013/2012] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:24 2022] DELETE /identity/v3/users/94f66148172842239c0c793bdbbf7257 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:25.253796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:25.254205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:25.254319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:25.271619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:25.272822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:25.338621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1000/2013] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:25.348648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:25.350110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:25.412573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d3c4-df0a-4bd0-be1a-0cef29004464 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:25.416698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:25.417491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:25.417782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:25.418055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:25.428215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:25.429673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:25.439869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1014/2014] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:25.902471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:25.904251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:25.919513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af92c7-bbeb-4e28-9199-8ae7c9b45fe3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:25.930412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:25.931569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:25.931924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:25.932386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] PATH_INFO: `/v3/projects/33e49ba5692240a9b6ced2305b3af73f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:25.933634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e49ba5692240a9b6ced2305b3af73f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:25.935681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:26.047426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e49ba5692240a9b6ced2305b3af73f', 'request_id': 'req-8c837d4e-43d9-42b6-a514-cc5569c755cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.116014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e49ba5692240a9b6ced2305b3af73f', 'request_id': 'req-8c837d4e-43d9-42b6-a514-cc5569c755cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.122440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e49ba5692240a9b6ced2305b3af73f', 'request_id': 'req-8c837d4e-43d9-42b6-a514-cc5569c755cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.135373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] The token cache is being invalidate because project 33e49ba5692240a9b6ced2305b3af73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:26.135656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.136305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.138003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1001/2015] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:25 2022] DELETE /identity/v3/projects/33e49ba5692240a9b6ced2305b3af73f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:26.142870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:26.153653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b17d7-31d7-4b4d-8666-02c5a563da9b service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:26.194279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:26.196516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:26.216968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:26.218140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:26.218432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:26.218714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] PATH_INFO: `/v3/users/50882a901ecd41a5a7c21890b78cb44c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:26.220280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50882a901ecd41a5a7c21890b78cb44c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:26.222391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:26.287715 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837d4e-43d9-42b6-a514-cc5569c755cf admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:26.293174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:26.294159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:26.294447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:26.295033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] PATH_INFO: `/v3/users/0d6cc9c45f4d4177b166d87eb71f6447` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:26.296620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6cc9c45f4d4177b166d87eb71f6447)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:26.298696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:26.445459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50882a901ecd41a5a7c21890b78cb44c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.460094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50882a901ecd41a5a7c21890b78cb44c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.460851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50882a901ecd41a5a7c21890b78cb44c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.462045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50882a901ecd41a5a7c21890b78cb44c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.529776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6cc9c45f4d4177b166d87eb71f6447'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.530563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6cc9c45f4d4177b166d87eb71f6447'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.538688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50882a901ecd41a5a7c21890b78cb44c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.550695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6cc9c45f4d4177b166d87eb71f6447'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.550695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6cc9c45f4d4177b166d87eb71f6447'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.567245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1015/2016] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:26 2022] DELETE /identity/v3/users/50882a901ecd41a5a7c21890b78cb44c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:26.652835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6cc9c45f4d4177b166d87eb71f6447'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:26.666818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1002/2017] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:26 2022] DELETE /identity/v3/users/0d6cc9c45f4d4177b166d87eb71f6447 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:26.968443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:26.969959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:27.048789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ed4d9-2a9d-49a7-a249-ad2432cef74b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:27.108933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:27.109807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.110091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.110367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] PATH_INFO: `/v3/projects/d61287a330cd4af9bd9dc26fd4dbd32c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.111666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61287a330cd4af9bd9dc26fd4dbd32c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:27.113758 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:27.135836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:27.139201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:27.151932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2e56-7624-4066-a924-ff4df8b14673 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:27.157122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:27.158210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.158412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.158696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] PATH_INFO: `/v3/projects/d19bc035e96d42d5833f63a1239ad81f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.159952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19bc035e96d42d5833f63a1239ad81f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:27.161854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:27.342269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19bc035e96d42d5833f63a1239ad81f', 'request_id': 'req-6260230b-525e-49f4-85cb-e9a4a4ba59c0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.343072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61287a330cd4af9bd9dc26fd4dbd32c', 'request_id': 'req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.401651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61287a330cd4af9bd9dc26fd4dbd32c', 'request_id': 'req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.412849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61287a330cd4af9bd9dc26fd4dbd32c', 'request_id': 'req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.419790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] The token cache is being invalidate because project d61287a330cd4af9bd9dc26fd4dbd32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:27.420077 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.420726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b9478c09-b5c6-4327-bce7-6bf8a24e3d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.422285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1016/2018] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:26 2022] DELETE /identity/v3/projects/d61287a330cd4af9bd9dc26fd4dbd32c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:27.427991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.428298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.428565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.447914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:27.449123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:27.464152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19bc035e96d42d5833f63a1239ad81f', 'request_id': 'req-6260230b-525e-49f4-85cb-e9a4a4ba59c0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.472109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19bc035e96d42d5833f63a1239ad81f', 'request_id': 'req-6260230b-525e-49f4-85cb-e9a4a4ba59c0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.484175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] The token cache is being invalidate because project d19bc035e96d42d5833f63a1239ad81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:27.484612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.485691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6260230b-525e-49f4-85cb-e9a4a4ba59c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:27.499227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1003/2019] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:27 2022] DELETE /identity/v3/projects/d19bc035e96d42d5833f63a1239ad81f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:27.515185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1017/2020] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:27.532147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.535782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.536357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.562907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:27.564412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:27.576685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1004/2021] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:27.582204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:27.596712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac359b1-48c5-4ebb-8596-4fab2ae4dc46 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:27.603055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:27.604203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.604491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.604767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.606071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:27.606071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:27.607606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:27.625617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1018/2022] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:17:27.628446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:27.639428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553520da-7bd5-4dd0-ac51-9172580f9a43 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:27.651968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:27.652915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.653165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.653466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.655730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:27.663229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:27.757347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1005/2023] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:27 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:27.762318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:27.773369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f24e-c6bd-45b5-84b7-a235fc96d723 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:27.833525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:27.834207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.834499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.834769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.835508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:27.838089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:27.954045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1019/2024] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:27 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:27.958679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:27.969402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d03c2-a376-4929-8276-148dfec253bc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:27.977277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:27.978210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:27.978610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:27.979096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:27.980037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:27.981700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:27.992934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1006/2025] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:27.997174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:28.007711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6d92-a9d2-42d3-a423-f3604a2fbec8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:28.013753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda49a5-b848-40d2-ab69-e3bc293f7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:28.014434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda49a5-b848-40d2-ab69-e3bc293f7c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:28.014723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda49a5-b848-40d2-ab69-e3bc293f7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:28.015031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda49a5-b848-40d2-ab69-e3bc293f7c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:28.015771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda49a5-b848-40d2-ab69-e3bc293f7c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:28.017562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda49a5-b848-40d2-ab69-e3bc293f7c53 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:28.028830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1020/2026] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:28.032931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:28.042899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3baafc-a62d-4842-aa75-f6755b69b5a3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:28.047670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:28.048567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:28.048852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:28.049131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] PATH_INFO: `/v3/projects/41ba2dfd59a64dc3b9f82fac37c1f278/users/480f3fa6c37b4d018ffa5803027d7be2/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:28.064680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ba2dfd59a64dc3b9f82fac37c1f278, user_id=480f3fa6c37b4d018ffa5803027d7be2, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:28.067405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:28.172511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1007/2027] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:28 2022] PUT /identity/v3/projects/41ba2dfd59a64dc3b9f82fac37c1f278/users/480f3fa6c37b4d018ffa5803027d7be2/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:28.181566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ae4cf-24f6-48c7-9561-02e36a601a5c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:28.181566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ae4cf-24f6-48c7-9561-02e36a601a5c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:28.181566 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ae4cf-24f6-48c7-9561-02e36a601a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:28.198147 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-088ae4cf-24f6-48c7-9561-02e36a601a5c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:28.199421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-088ae4cf-24f6-48c7-9561-02e36a601a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:28.260710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1021/2028] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:28.270453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:28.272391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:28.329879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9def-4815-4798-9b43-24732db84fbb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:28.333553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:28.334201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:28.334486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:28.334764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:28.344042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:28.345533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:28.355662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1008/2029] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:17:34.296240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a4207-ce52-46a3-8443-03b0409cf82a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:34.296760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a4207-ce52-46a3-8443-03b0409cf82a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:34.296852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a4207-ce52-46a3-8443-03b0409cf82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:34.339530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-122a4207-ce52-46a3-8443-03b0409cf82a None None] MFA Rules not processed for user `480f3fa6c37b4d018ffa5803027d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:34.340762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-122a4207-ce52-46a3-8443-03b0409cf82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:34.425072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1022/2030] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:34.436573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:34.438109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:34.564816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a175-b26c-41c0-9d49-78cf822878eb service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:34.570243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:34.571120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:34.571407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:34.571683 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:34.579811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:34.581382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:34.590284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1009/2031] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:37.426647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174db7e-43c8-4e61-adb1-06c765ba884b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:37.427193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174db7e-43c8-4e61-adb1-06c765ba884b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:37.427298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174db7e-43c8-4e61-adb1-06c765ba884b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:37.452510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5174db7e-43c8-4e61-adb1-06c765ba884b None None] MFA Rules not processed for user `480f3fa6c37b4d018ffa5803027d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:37.454125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5174db7e-43c8-4e61-adb1-06c765ba884b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:37.462554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1023/2032] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:43.893323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:43.894772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:43.942400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419077-17d4-4a86-aa06-fc01b9a2031b service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:43.946898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:43.947930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:43.948219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:43.948494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] PATH_INFO: `/v3/users/5f12b41dfcfa44a8a247e231a605322e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:43.949776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f12b41dfcfa44a8a247e231a605322e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:43.952468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:44.159174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f12b41dfcfa44a8a247e231a605322e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:44.159833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f12b41dfcfa44a8a247e231a605322e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:44.174943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f12b41dfcfa44a8a247e231a605322e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:44.175662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f12b41dfcfa44a8a247e231a605322e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:44.265679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f12b41dfcfa44a8a247e231a605322e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:44.281123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1010/2033] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:43 2022] DELETE /identity/v3/users/5f12b41dfcfa44a8a247e231a605322e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:44.285481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:44.285980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:44.286101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:44.316180 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:44.317398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:44.378777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1024/2034] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:44.385708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:44.388430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:44.482093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2b04-5e64-4d3a-b389-6a2cd13f247d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:44.489650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:44.491772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:44.491772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:44.491772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:44.511397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:44.513121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:44.523806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1011/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:45.234054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:45.237556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:45.249822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7539-425b-4821-9117-9651de3e8db8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:45.255360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:45.268334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:45.268850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:45.269219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] PATH_INFO: `/v3/projects/ee6f72957add4a739d872e570c6e83b7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:45.271636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6f72957add4a739d872e570c6e83b7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:45.274412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:45.385263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6f72957add4a739d872e570c6e83b7', 'request_id': 'req-42645459-0dd4-4746-bb35-fc8c81425b2f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.454177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6f72957add4a739d872e570c6e83b7', 'request_id': 'req-42645459-0dd4-4746-bb35-fc8c81425b2f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.460941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6f72957add4a739d872e570c6e83b7', 'request_id': 'req-42645459-0dd4-4746-bb35-fc8c81425b2f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.475729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] The token cache is being invalidate because project ee6f72957add4a739d872e570c6e83b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:45.476024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.476911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.478975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1025/2036] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:45 2022] DELETE /identity/v3/projects/ee6f72957add4a739d872e570c6e83b7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:45.482852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:45.493774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9dcd4-e806-488b-996e-973ea4ce2db9 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:45.589122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:45.590273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:45.590408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:45.590730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] PATH_INFO: `/v3/users/275449c3c157402c95c46e351bc54f94` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:45.592267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275449c3c157402c95c46e351bc54f94)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:45.594406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:45.796503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275449c3c157402c95c46e351bc54f94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.797237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275449c3c157402c95c46e351bc54f94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.812221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275449c3c157402c95c46e351bc54f94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.812958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275449c3c157402c95c46e351bc54f94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.883650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9b40dcb9-914f-401f-9f3e-3f580135eee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275449c3c157402c95c46e351bc54f94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:45.897506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1012/2037] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:45 2022] DELETE /identity/v3/users/275449c3c157402c95c46e351bc54f94 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:46.536522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:46.538299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:46.566815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42645459-0dd4-4746-bb35-fc8c81425b2f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:46.641283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:46.642172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:46.642450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:46.642724 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] PATH_INFO: `/v3/projects/ebcc1fe0955b4cfabafd6c7982fea397` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:46.643939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcc1fe0955b4cfabafd6c7982fea397)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:46.645853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:46.740765 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcc1fe0955b4cfabafd6c7982fea397', 'request_id': 'req-00fff1ba-286a-4fe0-9a71-736b735dd277'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:46.803755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcc1fe0955b4cfabafd6c7982fea397', 'request_id': 'req-00fff1ba-286a-4fe0-9a71-736b735dd277'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:46.811467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcc1fe0955b4cfabafd6c7982fea397', 'request_id': 'req-00fff1ba-286a-4fe0-9a71-736b735dd277'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:46.824840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] The token cache is being invalidate because project ebcc1fe0955b4cfabafd6c7982fea397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:46.825360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:46.826048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00fff1ba-286a-4fe0-9a71-736b735dd277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:46.828022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1026/2038] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:46 2022] DELETE /identity/v3/projects/ebcc1fe0955b4cfabafd6c7982fea397 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:46.832949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:46.833482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:46.833595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:46.871429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:46.872702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:46.935959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1013/2039] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:46.944847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:46.945136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:46.945409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:46.965869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:46.967186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:46.975137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1027/2040] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:46.979397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:46.989275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1b14-0e09-4be3-a26e-804fe0a8f661 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:46.993788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:46.997022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:46.997022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:46.997022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:46.997022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:46.997022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:46.997832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.009472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1014/2041] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:17:47.014365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.023583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ce3f2-302b-477a-b768-6c47333e1475 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.028884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.029538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.029820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.030095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.030782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.032781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.161560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1028/2042] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:47 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:47.172016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.181874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42235455-0749-4f34-ae80-64ab73c78f2d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.237512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.238209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.238506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.238779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.239499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.241403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.313077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1015/2043] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:47 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:47.317020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.327900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d13cb-3417-4070-9010-817c3942166e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.332555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.333202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.333501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.333813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.334535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.336192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.346457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1029/2044] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:47.350553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.361111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b9448-3bca-4398-9ec9-ad8f5b5e3d67 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.366189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03f260-25fe-4d35-ae47-77c7650ccd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.366886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f260-25fe-4d35-ae47-77c7650ccd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.367211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f260-25fe-4d35-ae47-77c7650ccd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.367556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f260-25fe-4d35-ae47-77c7650ccd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.368307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03f260-25fe-4d35-ae47-77c7650ccd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.369899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03f260-25fe-4d35-ae47-77c7650ccd40 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.381748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1016/2045] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:47.385975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.397168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9bf4-e547-43b5-95c1-1cdb993d9825 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.401924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.402790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.403103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.403376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] PATH_INFO: `/v3/projects/6bd16dc56ffd47c689b66a8c8bf50431/users/7bedec0d6935412e9cf705331dbd48c6/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.418120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd16dc56ffd47c689b66a8c8bf50431, user_id=7bedec0d6935412e9cf705331dbd48c6, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.421020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.489727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1030/2046] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:47 2022] PUT /identity/v3/projects/6bd16dc56ffd47c689b66a8c8bf50431/users/7bedec0d6935412e9cf705331dbd48c6/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:47.501461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.501720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.502002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.529703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] MFA Rules not processed for user `7bedec0d6935412e9cf705331dbd48c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:47.530924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:47.596522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1017/2047] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:47.601418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.664665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f9400-abdd-4318-bd62-3daea9adc6a2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.669896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.670557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.670841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.671153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.671840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.673730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.754419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1031/2048] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:47 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:47.758661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.770027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8627709-9ef1-42c6-b57b-44bf97304b92 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.828866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.829771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.830044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.830940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.831709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.833753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.929634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1018/2049] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:47 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:47.934525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.944933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733edb97-a8f0-44c0-9b58-d7fdf6c06faf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.949886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.950538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.950864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.951263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:47.952237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:47.953872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:47.968928 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1032/2050] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:47.970192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:47.980716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a44c-bb67-4a90-ae6f-d0bac4941f2e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:47.985564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:47.989910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:47.989910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:47.989910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] PATH_INFO: `/v3/projects/6dccde88364340f3b8888369d2786d53/users/16106b44424e4c55958a66037d135075/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:48.002773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dccde88364340f3b8888369d2786d53, user_id=16106b44424e4c55958a66037d135075, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:48.005473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:48.100907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1019/2051] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:47 2022] PUT /identity/v3/projects/6dccde88364340f3b8888369d2786d53/users/16106b44424e4c55958a66037d135075/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:48.105834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:48.115918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36528-a91b-4892-8477-8c57b2eaa9e6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:48.174080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee8ced-5a2b-4d3a-93b8-5a3b27903ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:48.174080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee8ced-5a2b-4d3a-93b8-5a3b27903ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:48.174080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee8ced-5a2b-4d3a-93b8-5a3b27903ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:48.174080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee8ced-5a2b-4d3a-93b8-5a3b27903ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:48.176991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee8ced-5a2b-4d3a-93b8-5a3b27903ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:48.176991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee8ced-5a2b-4d3a-93b8-5a3b27903ae7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:48.186725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1033/2052] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:48.191255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:48.202640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38a60b-e04b-4976-b5e6-f0740b3fd493 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:48.215078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:48.215078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:48.215335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:48.215489 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] PATH_INFO: `/v3/projects/6dccde88364340f3b8888369d2786d53/users/16106b44424e4c55958a66037d135075/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:48.217525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dccde88364340f3b8888369d2786d53, user_id=16106b44424e4c55958a66037d135075, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:48.220351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:48.231430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1020/2053] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:48 2022] PUT /identity/v3/projects/6dccde88364340f3b8888369d2786d53/users/16106b44424e4c55958a66037d135075/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:48.241883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:48.242305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:48.243960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:48.271852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] MFA Rules not processed for user `16106b44424e4c55958a66037d135075`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:48.273140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:48.344534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1034/2054] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:48.359738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:48.361413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:48.418754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf57588-547d-445e-b179-57a0330b2360 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:48.422304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:48.422947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:48.423258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:48.423535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:48.432334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:48.433862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:48.443397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1021/2055] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:49.339234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:49.348375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4b762-d0e7-4c0b-bd6a-5077656d279e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:49.353223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16106b44424e4c55958a66037d135075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dccde88364340f3b8888369d2786d53', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:49.353877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:49.354181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:49.354441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:49.355205 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:49.355518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:49.358026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:49.369472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1035/2056] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:17:49.374247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:49.383854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554a31-598e-483b-92cc-fc1a87558487 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:49.388991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16106b44424e4c55958a66037d135075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dccde88364340f3b8888369d2786d53', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:49.391793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:49.391793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:49.391793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:49.391793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:49.392820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:49.474326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1022/2057] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:49 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:49.478419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:49.488826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9c8e-6e2e-46fa-b08d-ef81c6a99c2b tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:49.546093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16106b44424e4c55958a66037d135075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dccde88364340f3b8888369d2786d53', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:49.546764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:49.547094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:49.547379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:49.548105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:49.548422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:49.550035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:49.562469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1036/2058] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:17:49.599393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:49.610743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0cbe8-5bd0-4e01-bd42-c5ea47f0000c tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:49.615488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16106b44424e4c55958a66037d135075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dccde88364340f3b8888369d2786d53', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:49.616448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:49.616733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:49.617008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] PATH_INFO: `/v3/projects/65f9d1637de646c98b4d39d5665180ef` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:49.618178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65f9d1637de646c98b4d39d5665180ef)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:49.620189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:49.716810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f9d1637de646c98b4d39d5665180ef', 'request_id': 'req-780b3cac-3600-4ed3-bd7d-c6f491de08cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:49.794466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f9d1637de646c98b4d39d5665180ef', 'request_id': 'req-780b3cac-3600-4ed3-bd7d-c6f491de08cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:49.800894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f9d1637de646c98b4d39d5665180ef', 'request_id': 'req-780b3cac-3600-4ed3-bd7d-c6f491de08cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:49.813290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] The token cache is being invalidate because project 65f9d1637de646c98b4d39d5665180ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:49.813765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:49.814467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-780b3cac-3600-4ed3-bd7d-c6f491de08cf tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:49.816116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1023/2059] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:49 2022] DELETE /identity/v3/projects/65f9d1637de646c98b4d39d5665180ef => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:50.384341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:50.386071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:50.450880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfda66-8faa-45a5-9c18-5e97a213c5c0 tempest-VolumeQuotaClassesTest-2002051069 tempest-VolumeQuotaClassesTest-2002051069-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:50.506390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:50.507204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:50.507488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:50.507761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] PATH_INFO: `/v3/users/7bedec0d6935412e9cf705331dbd48c6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:50.508938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bedec0d6935412e9cf705331dbd48c6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:50.510850 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:50.739103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bedec0d6935412e9cf705331dbd48c6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:50.751582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bedec0d6935412e9cf705331dbd48c6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:50.752395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bedec0d6935412e9cf705331dbd48c6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:50.753066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bedec0d6935412e9cf705331dbd48c6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:50.827889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bedec0d6935412e9cf705331dbd48c6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:50.846891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1037/2060] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:50 2022] DELETE /identity/v3/users/7bedec0d6935412e9cf705331dbd48c6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:50.852154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:50.853049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:50.853552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:50.893099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:50.894568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:50.986884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1024/2061] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:50.997150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:51.000036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:51.061771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111176-d90a-437a-bdc6-74111513a5a6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:51.064460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:51.065119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:51.065408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:51.065831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:51.076393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:51.077887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:51.088586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1038/2062] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:51.589077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:51.591008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:51.604798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda29dc6-d0e0-41cf-9f76-6d8d652fe64b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:51.611018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:51.612461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:51.612824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:51.613296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] PATH_INFO: `/v3/projects/6bd16dc56ffd47c689b66a8c8bf50431` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:51.616146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd16dc56ffd47c689b66a8c8bf50431)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:51.618185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:51.766437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd16dc56ffd47c689b66a8c8bf50431', 'request_id': 'req-6bef7f58-7da2-4a94-8a05-528628fac652'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:51.855601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd16dc56ffd47c689b66a8c8bf50431', 'request_id': 'req-6bef7f58-7da2-4a94-8a05-528628fac652'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:51.862355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd16dc56ffd47c689b66a8c8bf50431', 'request_id': 'req-6bef7f58-7da2-4a94-8a05-528628fac652'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:51.875442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] The token cache is being invalidate because project 6bd16dc56ffd47c689b66a8c8bf50431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:51.875731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:51.876484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:51.877949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1025/2063] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:51 2022] DELETE /identity/v3/projects/6bd16dc56ffd47c689b66a8c8bf50431 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:51.881945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:51.895528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbcf43-bfb5-4d1d-bd10-8fd433d296c1 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:51.966961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:51.967852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:51.968137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:51.968414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] PATH_INFO: `/v3/users/16106b44424e4c55958a66037d135075` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:51.969604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=16106b44424e4c55958a66037d135075)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:51.971680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:52.165994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16106b44424e4c55958a66037d135075'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.179200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16106b44424e4c55958a66037d135075'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.180359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16106b44424e4c55958a66037d135075'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.180598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16106b44424e4c55958a66037d135075'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.261494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb840a3d-3431-4702-bd79-aa763461c4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16106b44424e4c55958a66037d135075'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.280732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1039/2064] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:17:51 2022] DELETE /identity/v3/users/16106b44424e4c55958a66037d135075 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:17:52.715268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:52.716738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:52.732876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef7f58-7da2-4a94-8a05-528628fac652 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:52.800365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:52.801231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:52.801615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:52.801780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] PATH_INFO: `/v3/projects/6dccde88364340f3b8888369d2786d53` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:52.802976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dccde88364340f3b8888369d2786d53)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:52.805121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:52.902151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dccde88364340f3b8888369d2786d53', 'request_id': 'req-84252e80-0aab-42cf-b203-c0ecd4b08b56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.989432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dccde88364340f3b8888369d2786d53', 'request_id': 'req-84252e80-0aab-42cf-b203-c0ecd4b08b56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:52.995915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dccde88364340f3b8888369d2786d53', 'request_id': 'req-84252e80-0aab-42cf-b203-c0ecd4b08b56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:53.007614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] The token cache is being invalidate because project 6dccde88364340f3b8888369d2786d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:17:53.007908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:53.008579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-84252e80-0aab-42cf-b203-c0ecd4b08b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:17:53.010165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1026/2065] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:17:52 2022] DELETE /identity/v3/projects/6dccde88364340f3b8888369d2786d53 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:53.016008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.016485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.016578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.046251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:53.047601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:53.106370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1040/2066] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:53.114204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.114687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.114964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.132850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:53.134039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:53.143076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1027/2067] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:17:53.147238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.157729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306d501-9e35-4e45-874f-27003d9ed055 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.162301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.162950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.163277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.163558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.164289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:17:53.164595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.166198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.177540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1041/2068] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:17:53.182024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.191791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5b91-4322-4d3a-8adf-fa5e1c4ec246 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.196374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.197009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.197287 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.197561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.198266 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.200565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.302518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1028/2069] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:53.306669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.317952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2a485-6053-4ad9-ba0c-bec6064438c2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.374910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.375659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.375979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.376256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.376959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.378886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.505797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1042/2070] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:53.506934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.519488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2e11-430f-4ef6-a32e-f0e28f293a3e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.523829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.524536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.524822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.525097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.525832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.527509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.538236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1029/2071] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:53.542199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.552432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841132-4b1f-4ad7-a32c-eb53e98a7687 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.557121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16cd04-2e94-448d-8ec7-0e1fe7816633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.557713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16cd04-2e94-448d-8ec7-0e1fe7816633 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.558002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16cd04-2e94-448d-8ec7-0e1fe7816633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.558280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16cd04-2e94-448d-8ec7-0e1fe7816633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.559042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16cd04-2e94-448d-8ec7-0e1fe7816633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.561597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16cd04-2e94-448d-8ec7-0e1fe7816633 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.571592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1043/2072] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:53.576736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.586520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab9e16-86d1-4839-bdec-fb56fe112b33 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.591280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.592190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.592820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.592820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] PATH_INFO: `/v3/projects/a8349e2706194b2a9039ed73e0c0ed03/users/ab40df5fca6e4baf8d578025341994a6/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.609253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8349e2706194b2a9039ed73e0c0ed03, user_id=ab40df5fca6e4baf8d578025341994a6, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.611998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.719880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1030/2073] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:53 2022] PUT /identity/v3/projects/a8349e2706194b2a9039ed73e0c0ed03/users/ab40df5fca6e4baf8d578025341994a6/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:53.730244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.730680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.730940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.757527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] MFA Rules not processed for user `ab40df5fca6e4baf8d578025341994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:53.758722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:53.820419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1044/2074] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:53.824952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.888313 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766b32-4e85-4501-b1ff-0acf07321af6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:53.893240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:53.893903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:53.894189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:53.894498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:53.895240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:53.897135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:53.973026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1031/2075] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:53.977296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:53.988916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac84f4-3c41-4d6b-ab8b-45cc6a59c619 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.049104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.049772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.050059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.050340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.051081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.053010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.119538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1045/2076] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:53 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:54.123654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.134368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113e93d-b876-4867-808c-313b1acc233b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.139479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.140172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.140457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.140736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.141466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.143139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.155349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1032/2077] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:17:54.159582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.169918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b49e0-2653-4a53-99ca-c94b079f7dcf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.174945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79197c3d-e2c0-4668-b6b1-26f10e352982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.175635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79197c3d-e2c0-4668-b6b1-26f10e352982 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.175924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79197c3d-e2c0-4668-b6b1-26f10e352982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.176202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79197c3d-e2c0-4668-b6b1-26f10e352982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.177129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79197c3d-e2c0-4668-b6b1-26f10e352982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.178730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79197c3d-e2c0-4668-b6b1-26f10e352982 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.189275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1046/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:54.193476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.203599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cdbbc-2580-4afd-9755-725b2034cd7c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.211815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.212712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.212994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.213323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] PATH_INFO: `/v3/projects/132e0e405d1441c2a0eec21104e31fc0/users/f63ad3e2b0ba4cdc94576440fd1b4d74/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.228937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132e0e405d1441c2a0eec21104e31fc0, user_id=f63ad3e2b0ba4cdc94576440fd1b4d74, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.232293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.319376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1033/2079] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:54 2022] PUT /identity/v3/projects/132e0e405d1441c2a0eec21104e31fc0/users/f63ad3e2b0ba4cdc94576440fd1b4d74/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:54.331510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.331804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.332088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.360184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] MFA Rules not processed for user `f63ad3e2b0ba4cdc94576440fd1b4d74`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:54.361322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:54.425856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1047/2080] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:54.430531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.491206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b95a75-6dc2-4216-930f-4b977dc4dc88 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.495883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.496539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.496832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.497151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.497832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.499754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.631319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1034/2081] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:17:54 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:17:54.633430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.644864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384c1f2-6f19-45db-8361-195528a16553 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.701445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.702144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.702426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.702694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.703415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.705317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.804984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1048/2082] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:17:54 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:17:54.809005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.820402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002bf5-a15f-4feb-a7a2-d7ff96fed9c5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.825081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.827573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.827859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.828134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.828869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.830472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.841725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1035/2083] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:54.845900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.855972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc949-7a2f-4989-9700-9c5cafca60f0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:54.860809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:54.861677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:54.861963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:54.862238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] PATH_INFO: `/v3/projects/61f5526b4228499bb690c0e9baa57d1d/users/fa15c7e305c74275a7f160f9f8489e4e/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:54.878801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f5526b4228499bb690c0e9baa57d1d, user_id=fa15c7e305c74275a7f160f9f8489e4e, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:54.881476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:54.959409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1049/2084] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:54 2022] PUT /identity/v3/projects/61f5526b4228499bb690c0e9baa57d1d/users/fa15c7e305c74275a7f160f9f8489e4e/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:54.963419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:54.973856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e673f1-dc56-421e-8a55-82ac3ddc34ba admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:55.031109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35581c08-0d24-437f-95ab-9b56c89982a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:55.031777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581c08-0d24-437f-95ab-9b56c89982a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:55.032111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581c08-0d24-437f-95ab-9b56c89982a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:55.032374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581c08-0d24-437f-95ab-9b56c89982a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:55.033101 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35581c08-0d24-437f-95ab-9b56c89982a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:55.034702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35581c08-0d24-437f-95ab-9b56c89982a4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:55.045474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1036/2085] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:17:55.049594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:55.060461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30903a-1c51-473c-b731-5be6ba5fdb45 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:55.065461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:55.066364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:55.066650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:55.066932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] PATH_INFO: `/v3/projects/61f5526b4228499bb690c0e9baa57d1d/users/fa15c7e305c74275a7f160f9f8489e4e/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:55.068962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f5526b4228499bb690c0e9baa57d1d, user_id=fa15c7e305c74275a7f160f9f8489e4e, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:55.071644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:55.083085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1050/2086] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:17:55 2022] PUT /identity/v3/projects/61f5526b4228499bb690c0e9baa57d1d/users/fa15c7e305c74275a7f160f9f8489e4e/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:17:55.093481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:55.093803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:55.094100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:55.121179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] MFA Rules not processed for user `fa15c7e305c74275a7f160f9f8489e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:17:55.123555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:55.191718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1037/2087] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:17:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:17:55.202473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:55.204262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:55.261419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570e35-e4f1-48d4-90ae-c8635e619724 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:55.265624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:55.266298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:55.266585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:55.266865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:55.276159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:55.277593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:55.287851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1051/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:17:56.311567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:17:56.313134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:17:56.325142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d820a-04e6-42e4-ae13-ac8e4843e25f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:17:56.328899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:17:56.329947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:17:56.329947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:17:56.330142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:17:56.391958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:17:56.393466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:17:56.402982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1038/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:17:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:11.873890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:11.894285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c54b0-c5e8-4a56-bf3d-8c3a1be7913d service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:11.898165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a392ff5-5e1c-412d-b022-8b11191edcef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:11.898811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a392ff5-5e1c-412d-b022-8b11191edcef service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:11.899132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a392ff5-5e1c-412d-b022-8b11191edcef service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:11.899804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a392ff5-5e1c-412d-b022-8b11191edcef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:11.962300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a392ff5-5e1c-412d-b022-8b11191edcef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:11.963785 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a392ff5-5e1c-412d-b022-8b11191edcef service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:11.975220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1052/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:13.291148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:13.292654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:13.360885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4977ca-5f81-4d10-b57c-c82777a87237 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:13.370358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:13.370358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:13.370358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:13.370358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] PATH_INFO: `/v3/users/ab2ef54f713941ceb805a9027f38d78f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:13.371189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2ef54f713941ceb805a9027f38d78f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:13.371189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:13.525922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2ef54f713941ceb805a9027f38d78f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:13.526506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2ef54f713941ceb805a9027f38d78f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:13.540718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2ef54f713941ceb805a9027f38d78f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:13.541434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2ef54f713941ceb805a9027f38d78f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:13.608345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2ef54f713941ceb805a9027f38d78f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:13.621565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1039/2091] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:13 2022] DELETE /identity/v3/users/ab2ef54f713941ceb805a9027f38d78f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:13.627211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:13.627719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:13.627843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:13.645776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:13.647000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:13.707474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1053/2092] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:13.720222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:13.721651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:13.781369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c0efc-089c-4cca-a6a9-c87582892735 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:13.785276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3dcd2-ca6e-4610-ad89-8d98fe42f56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:13.785952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3dcd2-ca6e-4610-ad89-8d98fe42f56e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:13.786236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3dcd2-ca6e-4610-ad89-8d98fe42f56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:13.786516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3dcd2-ca6e-4610-ad89-8d98fe42f56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:13.795847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3dcd2-ca6e-4610-ad89-8d98fe42f56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:13.797260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3dcd2-ca6e-4610-ad89-8d98fe42f56e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:13.807379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1040/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:14.221611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.230031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:14.235196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f41a6-2e4a-4f7d-807c-40b8c1839ca6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.241055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.241926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.242218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.242498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] PATH_INFO: `/v3/projects/e62c01738ad54b24ab386c5849e5a80f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.243732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62c01738ad54b24ab386c5849e5a80f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.245661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:14.352101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62c01738ad54b24ab386c5849e5a80f', 'request_id': 'req-ac440855-c221-4956-8dce-9195bfb11817'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:14.419283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62c01738ad54b24ab386c5849e5a80f', 'request_id': 'req-ac440855-c221-4956-8dce-9195bfb11817'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:14.425986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62c01738ad54b24ab386c5849e5a80f', 'request_id': 'req-ac440855-c221-4956-8dce-9195bfb11817'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:14.436869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] The token cache is being invalidate because project e62c01738ad54b24ab386c5849e5a80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:14.437155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:14.437793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac440855-c221-4956-8dce-9195bfb11817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:14.439708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1054/2094] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:14 2022] DELETE /identity/v3/projects/e62c01738ad54b24ab386c5849e5a80f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:18:14.444616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.445071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.445162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.462550 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:14.463780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:14.522129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1041/2095] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:14.529885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.530208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.530493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.550368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:14.551532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:14.559404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1055/2096] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:14.563543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.573484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec085aa4-1f79-455c-909d-e9ddd9b40e48 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.578077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.578739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.579054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.579334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.580777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:18:14.581079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.582662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:14.595164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1042/2097] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:18:14.600753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.610178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e212-fd99-4597-b2aa-fb1ac58d3590 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.615377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.616143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.616434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.616798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.617507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.619472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:14.718261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1056/2098] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:14 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:14.723522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.733669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208a83-cd05-4969-8c4b-39e2655b6a74 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.792765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.793442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.793733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.794013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.794876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.796851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:14.874470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1043/2099] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:14 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:14.875784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.897087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71c65c-28de-4109-b7e6-40ae90b5cf44 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.901798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.902466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.902747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.903045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.903775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.905420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:14.920380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1057/2100] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:14.925004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.934953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619b33-2a44-42d4-bafa-4f40273548c3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.939764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2dd8d-3e71-4caf-aaca-57cc41b17f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.940416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2dd8d-3e71-4caf-aaca-57cc41b17f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.940700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2dd8d-3e71-4caf-aaca-57cc41b17f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.940977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2dd8d-3e71-4caf-aaca-57cc41b17f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.941710 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2dd8d-3e71-4caf-aaca-57cc41b17f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.943324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2dd8d-3e71-4caf-aaca-57cc41b17f95 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:14.953512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1044/2101] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:18:14.957880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:14.967704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167246b2-47fb-45b4-a3f5-1360fed3d975 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:14.973360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:14.974230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:14.974546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:14.974830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] PATH_INFO: `/v3/projects/933c231acf4240a4b22ffa835f31e243/users/a1d1cacac84d4ed39f43ba1315c7a321/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:14.989821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933c231acf4240a4b22ffa835f31e243, user_id=a1d1cacac84d4ed39f43ba1315c7a321, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:14.992528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:15.088764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1058/2102] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:14 2022] PUT /identity/v3/projects/933c231acf4240a4b22ffa835f31e243/users/a1d1cacac84d4ed39f43ba1315c7a321/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:15.099896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:15.100180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:15.100485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:15.127031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] MFA Rules not processed for user `a1d1cacac84d4ed39f43ba1315c7a321`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:15.128212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:15.196877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1045/2103] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:15.207912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:15.209625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:15.278121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce94d-5c14-45b1-bf2e-13e0c732f5d5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:15.281778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe714b-7932-4ca4-86b8-b876c006a913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:15.282422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe714b-7932-4ca4-86b8-b876c006a913 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:15.283269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe714b-7932-4ca4-86b8-b876c006a913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:15.283698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe714b-7932-4ca4-86b8-b876c006a913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:15.292044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe714b-7932-4ca4-86b8-b876c006a913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:15.293477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe714b-7932-4ca4-86b8-b876c006a913 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:15.302790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1059/2104] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:20.002914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:20.004409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:20.072174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9936313-6ad1-4acc-827b-e729d762fc3c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:20.077706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:20.078655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:20.078943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:20.079255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] PATH_INFO: `/v3/users/ab40df5fca6e4baf8d578025341994a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:20.081505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab40df5fca6e4baf8d578025341994a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:20.083483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:20.228702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab40df5fca6e4baf8d578025341994a6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:20.229414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab40df5fca6e4baf8d578025341994a6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:20.241659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab40df5fca6e4baf8d578025341994a6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:20.242349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab40df5fca6e4baf8d578025341994a6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:20.323205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab40df5fca6e4baf8d578025341994a6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:20.337000 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1046/2105] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:20 2022] DELETE /identity/v3/users/ab40df5fca6e4baf8d578025341994a6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:20.341500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:20.341979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:20.342071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:20.360616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:20.361820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:20.420386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1060/2106] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:18:20.430244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:20.431666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:20.489735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33beb-aa93-4530-9526-73a31a2c7537 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:20.493435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:20.494085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:20.494370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:20.494652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:20.505068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:20.506502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:20.515994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1047/2107] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:18:20.990930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:20.992555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:21.005065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb7e6a-b9c9-4151-93a2-979ce53dd6b8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:21.010795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:21.011714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:21.012914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:21.012914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] PATH_INFO: `/v3/projects/a8349e2706194b2a9039ed73e0c0ed03` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:21.013822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8349e2706194b2a9039ed73e0c0ed03)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:21.015873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:21.203889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8349e2706194b2a9039ed73e0c0ed03', 'request_id': 'req-1965ec36-a066-498e-abfa-7eaf61afa9aa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.306478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8349e2706194b2a9039ed73e0c0ed03', 'request_id': 'req-1965ec36-a066-498e-abfa-7eaf61afa9aa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.312479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8349e2706194b2a9039ed73e0c0ed03', 'request_id': 'req-1965ec36-a066-498e-abfa-7eaf61afa9aa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.324030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] The token cache is being invalidate because project a8349e2706194b2a9039ed73e0c0ed03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:21.324318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.324956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.326551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1061/2108] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:20 2022] DELETE /identity/v3/projects/a8349e2706194b2a9039ed73e0c0ed03 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:21.331628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:21.341435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3621bf9-2924-40c3-8280-5f400918db33 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:21.398406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:21.399647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:21.399758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:21.399956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] PATH_INFO: `/v3/users/f63ad3e2b0ba4cdc94576440fd1b4d74` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:21.401241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63ad3e2b0ba4cdc94576440fd1b4d74)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:21.403209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:21.657620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63ad3e2b0ba4cdc94576440fd1b4d74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.658350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63ad3e2b0ba4cdc94576440fd1b4d74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.670853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63ad3e2b0ba4cdc94576440fd1b4d74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.671630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63ad3e2b0ba4cdc94576440fd1b4d74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.781448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63ad3e2b0ba4cdc94576440fd1b4d74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:21.796726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1048/2109] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:21 2022] DELETE /identity/v3/users/f63ad3e2b0ba4cdc94576440fd1b4d74 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:22.228376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:22.229927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:22.245777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ec36-a066-498e-abfa-7eaf61afa9aa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:22.302414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:22.303232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:22.303517 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:22.303795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] PATH_INFO: `/v3/projects/132e0e405d1441c2a0eec21104e31fc0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:22.304984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132e0e405d1441c2a0eec21104e31fc0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:22.306901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:22.432410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132e0e405d1441c2a0eec21104e31fc0', 'request_id': 'req-00473d13-833a-41fb-b3f1-68f1db9fb870'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.529288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132e0e405d1441c2a0eec21104e31fc0', 'request_id': 'req-00473d13-833a-41fb-b3f1-68f1db9fb870'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.535849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132e0e405d1441c2a0eec21104e31fc0', 'request_id': 'req-00473d13-833a-41fb-b3f1-68f1db9fb870'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.546921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] The token cache is being invalidate because project 132e0e405d1441c2a0eec21104e31fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:22.547246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.547875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.550031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1062/2110] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:22 2022] DELETE /identity/v3/projects/132e0e405d1441c2a0eec21104e31fc0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:22.554155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:22.555602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:22.568445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e80c-a538-401e-9abb-0980740d1869 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:22.629703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:22.630580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:22.630943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:22.631172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] PATH_INFO: `/v3/users/fa15c7e305c74275a7f160f9f8489e4e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:22.632373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa15c7e305c74275a7f160f9f8489e4e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:22.634294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:22.777345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa15c7e305c74275a7f160f9f8489e4e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.778013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa15c7e305c74275a7f160f9f8489e4e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.790384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa15c7e305c74275a7f160f9f8489e4e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.791072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa15c7e305c74275a7f160f9f8489e4e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.849757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-63fc720d-3128-4a95-891a-0cb4628d0091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa15c7e305c74275a7f160f9f8489e4e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:22.864807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1049/2111] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:22 2022] DELETE /identity/v3/users/fa15c7e305c74275a7f160f9f8489e4e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:23.291429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:23.292921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:23.305950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473d13-833a-41fb-b3f1-68f1db9fb870 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:23.362536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:23.363441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:23.363762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:23.364171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] PATH_INFO: `/v3/projects/61f5526b4228499bb690c0e9baa57d1d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:23.365388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f5526b4228499bb690c0e9baa57d1d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:23.367333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:23.483882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f5526b4228499bb690c0e9baa57d1d', 'request_id': 'req-ad50a7d5-4636-4617-aa20-11c56ad8eee3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:23.552489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f5526b4228499bb690c0e9baa57d1d', 'request_id': 'req-ad50a7d5-4636-4617-aa20-11c56ad8eee3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:23.558288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f5526b4228499bb690c0e9baa57d1d', 'request_id': 'req-ad50a7d5-4636-4617-aa20-11c56ad8eee3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:23.570711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] The token cache is being invalidate because project 61f5526b4228499bb690c0e9baa57d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:23.570955 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:23.571623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad50a7d5-4636-4617-aa20-11c56ad8eee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:23.573151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1063/2112] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:23 2022] DELETE /identity/v3/projects/61f5526b4228499bb690c0e9baa57d1d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:23.579183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:23.579658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:23.579778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:23.598904 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:23.600190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:23.659438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1050/2113] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:23.675191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:23.676108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:23.676400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:23.698195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:23.700092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:23.719525 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1064/2114] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:23.729063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:23.740259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390ed7-c0a5-4190-bcf9-8a5381435c3e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:23.745340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:23.745998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:23.746285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:23.746565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:23.747435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:18:23.747694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:23.751406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:23.763748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1051/2115] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:18:23.768472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:23.778164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc0df1-2b0b-4416-be67-ed10ecba403f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:23.783255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:23.783974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:23.784262 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:23.784538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:23.785326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:23.787246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:23.891825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1065/2116] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:23 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:18:23.897054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:23.907002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b92a4-fa45-4f2e-b51c-89003afdd973 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:23.968050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:23.968810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:23.972280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:23.972280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:23.972280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:23.973367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.035025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1052/2117] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:23 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:24.039245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.050586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d6c5-c785-431a-8f73-aebd861ec6c2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.056314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.061628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.061628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.061628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.061628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.061628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.071014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1066/2118] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:24.075352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.086209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1dd09-6a05-4c83-aa18-5eb465fbe8dc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.091357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a6aba-36c2-4a3f-9f81-0514b1ec64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.092022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a6aba-36c2-4a3f-9f81-0514b1ec64bb admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.092307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a6aba-36c2-4a3f-9f81-0514b1ec64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.092584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a6aba-36c2-4a3f-9f81-0514b1ec64bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.093311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a6aba-36c2-4a3f-9f81-0514b1ec64bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.094899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a6aba-36c2-4a3f-9f81-0514b1ec64bb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.107990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1053/2119] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:24.111516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.125156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c654-5f8f-4d7f-aec3-10fa9b4676d4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.132318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.133412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.133983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.134211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] PATH_INFO: `/v3/projects/35b0c6192f274dc38458196eb164d8f3/users/7dc6579639f843559c3af60a1fbd4525/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.156567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b0c6192f274dc38458196eb164d8f3, user_id=7dc6579639f843559c3af60a1fbd4525, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.161223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.238235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1067/2120] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:24 2022] PUT /identity/v3/projects/35b0c6192f274dc38458196eb164d8f3/users/7dc6579639f843559c3af60a1fbd4525/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:24.247144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.247445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.247729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.275822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] MFA Rules not processed for user `7dc6579639f843559c3af60a1fbd4525`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:24.277099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:24.357085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.359221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1054/2121] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:24.438683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b494d48-f8fb-4e72-a974-6db93b82fab3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.443606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.444337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.444626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.444905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.445627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.447585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.546616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1068/2122] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:24 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:24.548227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.560982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d4d74-7947-4b57-872d-658e577e8f7e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.624369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.625044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.625307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.625649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.626358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.628761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.738961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1055/2123] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:24 2022] POST /identity/v3/users => generated 307 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:24.740233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.751733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa3242-49e6-4efa-afae-6ab9cfa6580f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.757167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.757718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.758011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.758292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.759137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.760741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.773447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1069/2124] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:24.777637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.790959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b30-516a-464a-b8c7-436595327a09 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.795646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.796605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.796905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.797232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] PATH_INFO: `/v3/projects/f6d6d5222aa44929aaf5c529344f96d8/users/a73cf25bde354544a429317bcededace/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.813438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d6d5222aa44929aaf5c529344f96d8, user_id=a73cf25bde354544a429317bcededace, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.817184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:24.915669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1056/2125] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:24 2022] PUT /identity/v3/projects/f6d6d5222aa44929aaf5c529344f96d8/users/a73cf25bde354544a429317bcededace/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:24.919643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:24.930488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72461ed4-6e71-44d6-9f14-732f7d35a14a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:24.990645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33bb3-9a6e-4748-b3f2-008f90b3f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:24.991347 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33bb3-9a6e-4748-b3f2-008f90b3f877 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:24.991632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33bb3-9a6e-4748-b3f2-008f90b3f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:24.991907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33bb3-9a6e-4748-b3f2-008f90b3f877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:24.992633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33bb3-9a6e-4748-b3f2-008f90b3f877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:24.994222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33bb3-9a6e-4748-b3f2-008f90b3f877 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:25.007160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1070/2126] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:25.009321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:25.020475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e01c1-50f7-435e-ae38-e68dfc52713b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:25.035914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:25.038335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:25.038335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:25.038335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] PATH_INFO: `/v3/projects/f6d6d5222aa44929aaf5c529344f96d8/users/a73cf25bde354544a429317bcededace/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:25.039812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d6d5222aa44929aaf5c529344f96d8, user_id=a73cf25bde354544a429317bcededace, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:25.042770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:25.054772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1057/2127] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:25 2022] PUT /identity/v3/projects/f6d6d5222aa44929aaf5c529344f96d8/users/a73cf25bde354544a429317bcededace/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:25.065137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:25.065461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:25.067292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:25.096258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] MFA Rules not processed for user `a73cf25bde354544a429317bcededace`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:25.098803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:25.183196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1071/2128] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:25.195198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:25.196980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:25.257851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bfe34-7269-4617-9889-c8671e56780d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:25.261736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:25.262398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:25.262684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:25.262963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:25.273582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:25.275140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:25.287036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1058/2129] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:25.463082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:25.464768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:25.509711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:25.520426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a295-277d-492f-991e-422ae151ffff service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:25.524696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d9590-e76c-4dad-beb1-28fcdc035439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:25.525497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9590-e76c-4dad-beb1-28fcdc035439 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:25.525897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9590-e76c-4dad-beb1-28fcdc035439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:25.526247 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d9590-e76c-4dad-beb1-28fcdc035439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:25.546976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f465-3fac-43dd-9dd0-b54cc368a178 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:25.556341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:25.557496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:25.557927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:25.558354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] PATH_INFO: `/v3/users/23ade6455f85466b896d5c9b474d6cb7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:25.560220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ade6455f85466b896d5c9b474d6cb7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:25.562182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:25.608263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9590-e76c-4dad-beb1-28fcdc035439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:25.610124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d9590-e76c-4dad-beb1-28fcdc035439 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:25.620385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1059/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:18:25.757810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ade6455f85466b896d5c9b474d6cb7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:25.775795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ade6455f85466b896d5c9b474d6cb7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:25.776631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ade6455f85466b896d5c9b474d6cb7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:25.777313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ade6455f85466b896d5c9b474d6cb7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:25.884400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ade6455f85466b896d5c9b474d6cb7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:25.897784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1072/2131] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:25 2022] DELETE /identity/v3/users/23ade6455f85466b896d5c9b474d6cb7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:25.902409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a2b8e-1556-463b-a5c1-6dc74eb83a15 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:25.902884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a2b8e-1556-463b-a5c1-6dc74eb83a15 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:25.903045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a2b8e-1556-463b-a5c1-6dc74eb83a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:25.920863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d71a2b8e-1556-463b-a5c1-6dc74eb83a15 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:25.922081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d71a2b8e-1556-463b-a5c1-6dc74eb83a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:25.986110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1060/2132] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:25.996661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:25.998546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:26.068756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65f7f-b850-4c05-8131-7836ca31e8c2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:26.072900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:26.073557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.073847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.074132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.084270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:26.085780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:26.098821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1073/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:26.532393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93804779-03a7-43b5-a337-4a3ea8759384 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.532695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93804779-03a7-43b5-a337-4a3ea8759384 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.532987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93804779-03a7-43b5-a337-4a3ea8759384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.552070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-93804779-03a7-43b5-a337-4a3ea8759384 None None] MFA Rules not processed for user `721476a70afb4d1095a89215f1016045`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:26.553519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-93804779-03a7-43b5-a337-4a3ea8759384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:26.578219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:26.579772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:26.604218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403b08-4c6f-4880-b1c6-ca0476238dca service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:26.610099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:26.611329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.611956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.612570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] PATH_INFO: `/v3/projects/ec653f06d26145639a9025236956aeba` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.614851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec653f06d26145639a9025236956aeba)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:26.617394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:26.618053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1061/2134] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:26.726230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec653f06d26145639a9025236956aeba', 'request_id': 'req-5ad58a1d-be7a-4e50-9c04-add074e27f51'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:26.770961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec653f06d26145639a9025236956aeba', 'request_id': 'req-5ad58a1d-be7a-4e50-9c04-add074e27f51'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:26.777208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec653f06d26145639a9025236956aeba', 'request_id': 'req-5ad58a1d-be7a-4e50-9c04-add074e27f51'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:26.789486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] The token cache is being invalidate because project ec653f06d26145639a9025236956aeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:26.789777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:26.790457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ad58a1d-be7a-4e50-9c04-add074e27f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:26.792103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1074/2135] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:26 2022] DELETE /identity/v3/projects/ec653f06d26145639a9025236956aeba => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:18:26.797066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.797438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.797729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.817761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:26.819041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:26.883442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1062/2136] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:26.891492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.891805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.892087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.912840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:26.914352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:26.922478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1075/2137] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:26.926919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:26.936474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ae055-cee0-4a08-b30f-b60785927d45 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:26.942162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:26.942851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.943198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.943485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.944245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:18:26.944552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:26.946276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:26.961729 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1063/2138] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:18:26.966777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:26.977923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ec6af-c7ad-43bd-a568-82ddd10fdf6a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:26.983575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:26.984263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:26.984546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:26.984825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:26.985683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:26.987766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:27.092461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1076/2139] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:26 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:27.096680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:27.107581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45ea95-b9fb-475c-a3c5-187cd554bf49 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:27.166508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:27.167217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:27.167505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:27.167788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:27.168486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:27.170466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:27.267590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1064/2140] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:27 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:27.273453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:27.283931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e699-59ef-4f37-b104-050dfa9f9fc8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:27.289345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:27.290000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:27.290315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:27.290791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:27.291592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:27.293209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:27.304778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1077/2141] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:18:27.308877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:27.322227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66827040-d8c3-4c9a-a23b-570fca50bbb3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:27.326892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb65cd-b176-4a3e-91a8-f0b1fc8d9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:27.327589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb65cd-b176-4a3e-91a8-f0b1fc8d9986 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:27.327878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb65cd-b176-4a3e-91a8-f0b1fc8d9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:27.328160 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb65cd-b176-4a3e-91a8-f0b1fc8d9986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:27.330525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb65cd-b176-4a3e-91a8-f0b1fc8d9986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:27.330525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb65cd-b176-4a3e-91a8-f0b1fc8d9986 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:27.340984 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1065/2142] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:27.345271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:27.355963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbc686-d19b-4c13-936f-6be5462390ad admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:27.361904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:27.363337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:27.363683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:27.364103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] PATH_INFO: `/v3/projects/6bc12faa457f4ea9a4ecd0da053e702f/users/ea79bf0354924adbb93145d7c9ced99b/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:27.381400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc12faa457f4ea9a4ecd0da053e702f, user_id=ea79bf0354924adbb93145d7c9ced99b, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:27.384164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:27.451459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1078/2143] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:27 2022] PUT /identity/v3/projects/6bc12faa457f4ea9a4ecd0da053e702f/users/ea79bf0354924adbb93145d7c9ced99b/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:27.463042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:27.463042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:27.463253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:27.506123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] MFA Rules not processed for user `ea79bf0354924adbb93145d7c9ced99b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:27.507637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:27.579752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1066/2144] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:27.591024 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:27.592744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:27.651694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b606a-6214-400c-b7c2-8f38d020e41e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:27.655389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a3b9-4f97-49c4-98e4-a92f00d38882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:27.656039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a3b9-4f97-49c4-98e4-a92f00d38882 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:27.656444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a3b9-4f97-49c4-98e4-a92f00d38882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:27.656723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a3b9-4f97-49c4-98e4-a92f00d38882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:27.665858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a3b9-4f97-49c4-98e4-a92f00d38882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:27.667345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a3b9-4f97-49c4-98e4-a92f00d38882 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:27.677975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1079/2145] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:30.183393 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:30.184458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:30.251233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1c02-8c70-433f-bba1-b4ca50ae0082 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:30.256906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:30.260901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:30.260901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:30.260901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] PATH_INFO: `/v3/users/a1d1cacac84d4ed39f43ba1315c7a321` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:30.260901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d1cacac84d4ed39f43ba1315c7a321)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:30.261624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:30.508175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d1cacac84d4ed39f43ba1315c7a321'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:30.508864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d1cacac84d4ed39f43ba1315c7a321'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:30.521577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d1cacac84d4ed39f43ba1315c7a321'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:30.522317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d1cacac84d4ed39f43ba1315c7a321'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:30.605045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d1cacac84d4ed39f43ba1315c7a321'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:30.622565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1067/2146] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:30 2022] DELETE /identity/v3/users/a1d1cacac84d4ed39f43ba1315c7a321 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:30.627044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:30.627535 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:30.627647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:30.645412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:30.646608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:30.718216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1080/2147] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:30.729272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:30.731102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:30.801406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd2d1-c981-43a6-af4b-a73b74785910 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:30.811828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779b5d-2a79-49ac-94b8-913f2e4868a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:30.812556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779b5d-2a79-49ac-94b8-913f2e4868a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:30.813465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779b5d-2a79-49ac-94b8-913f2e4868a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:30.813465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779b5d-2a79-49ac-94b8-913f2e4868a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:30.824274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce779b5d-2a79-49ac-94b8-913f2e4868a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:30.835836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce779b5d-2a79-49ac-94b8-913f2e4868a4 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:30.847262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1068/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:31.378514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:31.381621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:31.401746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad8f0-4b3c-4f4c-b1ff-f8b28bd0b0bf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:31.406593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:31.409087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:31.409087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:31.409087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] PATH_INFO: `/v3/projects/933c231acf4240a4b22ffa835f31e243` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:31.409397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933c231acf4240a4b22ffa835f31e243)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:31.411980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:31.539529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933c231acf4240a4b22ffa835f31e243', 'request_id': 'req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:31.605845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933c231acf4240a4b22ffa835f31e243', 'request_id': 'req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:31.612381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933c231acf4240a4b22ffa835f31e243', 'request_id': 'req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:31.626132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] The token cache is being invalidate because project 933c231acf4240a4b22ffa835f31e243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:31.626431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:31.627132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0b40a28b-0743-49c1-9e19-5f019d4bf7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:31.629960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1081/2149] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:31 2022] DELETE /identity/v3/projects/933c231acf4240a4b22ffa835f31e243 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:31.635352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:31.635855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:31.635949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:31.655467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:31.656795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:31.763613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1069/2150] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:31.765477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:31.765772 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:31.766053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:31.789259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:31.790491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:31.799618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1082/2151] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:31.805211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:31.815123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea92a11-b413-4836-9908-346f880c8ff4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:31.820615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:31.821354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:31.821568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:31.821858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:31.822618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:18:31.822881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:31.824548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:31.837126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1070/2152] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:18:31.843745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:31.854423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36632-5ef5-4360-916e-ec97f9fd2ddf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:31.859448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:31.860113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:31.860400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:31.860678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:31.861565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:31.867270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:31.975683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1083/2153] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:31 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:31.979718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:31.993690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4c889-fe00-45a6-a20a-3c2bd5bccb6e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.069445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.070694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.072227 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.072751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.073679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.075986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.187231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1071/2154] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:31 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:18:32.188364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:32.208958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32361f-9363-4429-bdf5-d69184a59393 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.219191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.220072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.221177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.221467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.222211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.224159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.229516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:32.231294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:32.235979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1084/2155] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:32.242874 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:32.244049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234d6f-7150-41a0-8dea-ff1ef10f2021 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.249699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.250575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.250860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.251177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] PATH_INFO: `/v3/users/7dc6579639f843559c3af60a1fbd4525` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.258914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc6579639f843559c3af60a1fbd4525)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.260030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7a8a-3124-4c9f-bcd1-712be8c22976 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.261725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.264925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.265660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.265952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.266229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.267012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.268623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.279930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1085/2156] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:32.284286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:32.295335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95d2a0-0ab7-4a96-967e-8a2ca06ea5aa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.300264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4893b-7f67-41ee-8958-9e5a9f01d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.301228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4893b-7f67-41ee-8958-9e5a9f01d952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.301520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4893b-7f67-41ee-8958-9e5a9f01d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.301801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4893b-7f67-41ee-8958-9e5a9f01d952 admin admin] PATH_INFO: `/v3/projects/5b095a86e9004719a23c3a0bd0f8a986/users/af5972d049c243b48d0a59a7d4028273/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.316888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4893b-7f67-41ee-8958-9e5a9f01d952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b095a86e9004719a23c3a0bd0f8a986, user_id=af5972d049c243b48d0a59a7d4028273, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.319679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4893b-7f67-41ee-8958-9e5a9f01d952 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.371793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1086/2157] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:32 2022] PUT /identity/v3/projects/5b095a86e9004719a23c3a0bd0f8a986/users/af5972d049c243b48d0a59a7d4028273/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:18:32.376710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.376998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.377466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.395912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:32.397096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:32.439195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc6579639f843559c3af60a1fbd4525'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:32.440069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc6579639f843559c3af60a1fbd4525'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:32.461779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc6579639f843559c3af60a1fbd4525'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:32.463094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc6579639f843559c3af60a1fbd4525'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:32.464115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1087/2158] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:18:32.478946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:32.480426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:32.521209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba8aba90-3718-4a1b-b4de-085a065d3a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc6579639f843559c3af60a1fbd4525'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:32.534960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1072/2159] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:32 2022] DELETE /identity/v3/users/7dc6579639f843559c3af60a1fbd4525 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:18:32.539827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.539970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1a07a-2c13-438a-852c-d296b4602b5b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.540118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.540396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.559826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:32.561051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:32.597660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.598584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.598938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.599321 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.601276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:32.631781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1073/2160] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:32.638301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:32.639890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:32.652046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e73eec-295a-4590-a72f-b2d76eaf774d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:32.655759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:32.656407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:32.656694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:32.656968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:32.668062 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.669014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:32.669641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.670472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:32.680493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1074/2161] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:18:32.680968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1088/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:18:33.151407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:33.152935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:33.166230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4129-f405-4000-a703-76caa1886dae service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:33.172803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:33.176315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:33.176315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:33.176315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] PATH_INFO: `/v3/projects/35b0c6192f274dc38458196eb164d8f3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:33.176315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b0c6192f274dc38458196eb164d8f3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:33.177974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:33.291617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b0c6192f274dc38458196eb164d8f3', 'request_id': 'req-9370de5c-8bc9-4041-8571-69e6a4670961'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.382532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b0c6192f274dc38458196eb164d8f3', 'request_id': 'req-9370de5c-8bc9-4041-8571-69e6a4670961'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.389037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b0c6192f274dc38458196eb164d8f3', 'request_id': 'req-9370de5c-8bc9-4041-8571-69e6a4670961'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.402365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] The token cache is being invalidate because project 35b0c6192f274dc38458196eb164d8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:33.402582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.403269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.405656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1089/2163] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:33 2022] DELETE /identity/v3/projects/35b0c6192f274dc38458196eb164d8f3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:33.409749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:33.419481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfce743-885a-4ea8-9882-926baa19521e service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:33.491403 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:33.500738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:33.500738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:33.500738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] PATH_INFO: `/v3/users/a73cf25bde354544a429317bcededace` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:33.500738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73cf25bde354544a429317bcededace)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:33.500738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:33.688122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73cf25bde354544a429317bcededace'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.688811 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73cf25bde354544a429317bcededace'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.700347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73cf25bde354544a429317bcededace'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.701031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73cf25bde354544a429317bcededace'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.782610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-91325ec6-7509-468a-b8ad-de8e7a866513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73cf25bde354544a429317bcededace'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:33.796863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1075/2164] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:18:33 2022] DELETE /identity/v3/users/a73cf25bde354544a429317bcededace => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:34.277781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:34.279979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:34.298934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370de5c-8bc9-4041-8571-69e6a4670961 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:34.379708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:34.380586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:34.380870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:34.381322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] PATH_INFO: `/v3/projects/f6d6d5222aa44929aaf5c529344f96d8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:34.382703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d6d5222aa44929aaf5c529344f96d8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:34.384658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:34.536875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d6d5222aa44929aaf5c529344f96d8', 'request_id': 'req-bebfc079-52a0-49e9-85cd-081c7f06a80e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:34.640500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d6d5222aa44929aaf5c529344f96d8', 'request_id': 'req-bebfc079-52a0-49e9-85cd-081c7f06a80e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:34.649161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d6d5222aa44929aaf5c529344f96d8', 'request_id': 'req-bebfc079-52a0-49e9-85cd-081c7f06a80e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:34.663328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] The token cache is being invalidate because project f6d6d5222aa44929aaf5c529344f96d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:18:34.663964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:34.664981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bebfc079-52a0-49e9-85cd-081c7f06a80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:18:34.671188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1090/2165] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:18:34 2022] DELETE /identity/v3/projects/f6d6d5222aa44929aaf5c529344f96d8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:34.673100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:34.673842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:34.673990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:34.695086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:34.696707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:34.785451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1076/2166] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:34.795112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:34.795477 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:34.795815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:34.814428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:34.815742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:34.824440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1091/2167] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:34.828457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:34.838702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9c692-d1ca-4c65-b5b7-c04e5acabf3a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:34.844877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:34.845843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:34.846228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:34.846556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:34.851353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:18:34.851353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:34.851353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:34.864793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1077/2168] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:18:34.869379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:34.882034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62df15-c265-4468-a8a4-664247459f1b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:34.887997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:34.891879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:34.891879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:34.891879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:34.891879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:34.895637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:34.986131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1092/2169] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:34 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:34.991039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:35.002251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712029c-86b8-4264-9686-8c4ba75deab5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:35.064569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:35.065258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:35.065546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:35.065826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:35.066537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:35.068674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:35.159635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1078/2170] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:34 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:18:35.164248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:35.175587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e17410-5dc1-4b2b-b8c0-e05be659964b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:35.181042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:35.181755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:35.182630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:35.182767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:35.183778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:35.185363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:35.205318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1093/2171] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:35.209601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:35.219977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5acb-6c5a-485c-a5db-6be36070d65d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:35.230139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fc972-ccdf-4fac-b5e6-d8e71b7f15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:35.230139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fc972-ccdf-4fac-b5e6-d8e71b7f15be admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:35.230139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fc972-ccdf-4fac-b5e6-d8e71b7f15be admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:35.230139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fc972-ccdf-4fac-b5e6-d8e71b7f15be admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:35.230560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fc972-ccdf-4fac-b5e6-d8e71b7f15be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:35.230560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fc972-ccdf-4fac-b5e6-d8e71b7f15be admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:35.241060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1079/2172] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:35.245093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:35.258365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec0c27-f68d-4163-ae56-a431b4a3bd98 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:35.263737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:35.264655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:35.264940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:35.265216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] PATH_INFO: `/v3/projects/4b68a11882a6412eb56fce7c38668928/users/cd77ccd4aedc4fad9fb75fb2f358d859/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:35.285261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b68a11882a6412eb56fce7c38668928, user_id=cd77ccd4aedc4fad9fb75fb2f358d859, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:35.287922 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:35.406515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1094/2173] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:35 2022] PUT /identity/v3/projects/4b68a11882a6412eb56fce7c38668928/users/cd77ccd4aedc4fad9fb75fb2f358d859/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:35.411744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4c8e-8e85-49f8-b05e-9c98042e8a68 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:35.412043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4c8e-8e85-49f8-b05e-9c98042e8a68 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:35.412324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4c8e-8e85-49f8-b05e-9c98042e8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:35.430724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1c3e4c8e-8e85-49f8-b05e-9c98042e8a68 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:35.437924 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1c3e4c8e-8e85-49f8-b05e-9c98042e8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:35.494571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1080/2174] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:35.504763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:35.506781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:35.565320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983dac1-697e-4ddd-83f6-160593a8e296 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:35.570445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:35.571130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:35.571421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:35.571700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:35.581408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:35.583636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:35.604374 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1095/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:37.238677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:37.239331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:37.239431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:37.268190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] MFA Rules not processed for user `cd77ccd4aedc4fad9fb75fb2f358d859`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:37.269963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:37.356733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1081/2176] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:37.361275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:37.373540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ff64d-0da0-4795-9d2e-6c6d95f24940 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:37.381394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:37.382481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:37.383371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:37.383906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:37.384816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:37.387728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:37.553240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1096/2177] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:37 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:37.557920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:37.570463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab27dc-1256-4975-b92b-c907c8959996 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:37.671761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:37.673543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:37.673835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:37.674117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:37.675061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:37.677845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:37.772717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1082/2178] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:37 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:18:37.776889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:37.788336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8ce1-c4ae-44e3-bb04-9bed4fcb0124 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:37.793537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:37.794294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:37.794578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:37.794854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:37.795633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:37.797365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:37.810015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1097/2179] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:18:37.814280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:37.825624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2052af0-4919-4864-b2d6-5c4bcfac8995 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:37.831244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:37.832145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:37.832429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:37.833417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] PATH_INFO: `/v3/projects/b15b0b40065e4ef7b99f1c76394cb099/users/0914d75f01294f45ac9ca44f372b87bc/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:37.856042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15b0b40065e4ef7b99f1c76394cb099, user_id=0914d75f01294f45ac9ca44f372b87bc, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:37.860619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:37.952395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1083/2180] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:37 2022] PUT /identity/v3/projects/b15b0b40065e4ef7b99f1c76394cb099/users/0914d75f01294f45ac9ca44f372b87bc/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:37.956474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:37.967945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ba048-a749-46b1-a346-70ba9f78540b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:38.032149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29f9d-3557-4f54-addf-0fb9fbf425a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:38.032838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29f9d-3557-4f54-addf-0fb9fbf425a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:38.033119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29f9d-3557-4f54-addf-0fb9fbf425a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:38.033540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29f9d-3557-4f54-addf-0fb9fbf425a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:38.034504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a29f9d-3557-4f54-addf-0fb9fbf425a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:38.037031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a29f9d-3557-4f54-addf-0fb9fbf425a2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:38.049059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1098/2181] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:38.052948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:38.065151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b880d88-aaa3-490b-b74e-86d357b55cca admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:38.070138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8c7e-7a63-4234-9def-ada974bc2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:38.071108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8c7e-7a63-4234-9def-ada974bc2f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:38.071353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8c7e-7a63-4234-9def-ada974bc2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:38.078941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8c7e-7a63-4234-9def-ada974bc2f2d admin admin] PATH_INFO: `/v3/projects/b15b0b40065e4ef7b99f1c76394cb099/users/0914d75f01294f45ac9ca44f372b87bc/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:38.078941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8c7e-7a63-4234-9def-ada974bc2f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15b0b40065e4ef7b99f1c76394cb099, user_id=0914d75f01294f45ac9ca44f372b87bc, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:38.078941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8c7e-7a63-4234-9def-ada974bc2f2d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:38.088779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1084/2182] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:38 2022] PUT /identity/v3/projects/b15b0b40065e4ef7b99f1c76394cb099/users/0914d75f01294f45ac9ca44f372b87bc/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:39.482020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:39.482588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:39.483367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:39.513056 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] MFA Rules not processed for user `0914d75f01294f45ac9ca44f372b87bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:39.514516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:39.542404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:39.542787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:39.542864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:39.581391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] MFA Rules not processed for user `af5972d049c243b48d0a59a7d4028273`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:39.582656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:39.605096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1099/2183] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:39.620300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:39.621991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:39.678510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1085/2184] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:39.679560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:39.681406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:39.690636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af064f2-7bf9-462c-af7c-fdd2e30c0dd3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:39.700065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:39.700971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:39.701716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:39.702299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:39.765112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940937e6-3b01-4e6f-8ce6-611c9ebeaa76 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:39.767749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:39.769199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:39.772331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:39.773220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:39.773650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:39.774078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:39.774773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:39.776713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:39.779135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1100/2185] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:39.896851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1086/2186] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:18:39 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:39.903336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:39.916949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6633-5ba3-435b-89c1-c97c73d6892d service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:39.977092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:39.977995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:39.978574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:39.978923 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:39.979719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:39.982011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:40.116667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1101/2187] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:18:39 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:18:40.120417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:40.134086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6a76-803a-4b79-9a11-a21d1fdbdc5f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:40.146320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:40.147054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:40.147349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:40.147632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:40.148384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:40.150007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:40.161815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1087/2188] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:40.166404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:40.176338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c73b0b-9af7-4529-b9dc-eca4fd1e31ed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:40.181081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:40.181951 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:40.182226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:40.182496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] PATH_INFO: `/v3/projects/f31b7ff7d7544a43be9bc12dea90c978/users/5bc51f418c9244e39021aabc60179dd2/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:40.198934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31b7ff7d7544a43be9bc12dea90c978, user_id=5bc51f418c9244e39021aabc60179dd2, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:40.201822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:40.299042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1102/2189] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:40 2022] PUT /identity/v3/projects/f31b7ff7d7544a43be9bc12dea90c978/users/5bc51f418c9244e39021aabc60179dd2/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:18:40.303276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:40.313842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374752-3cda-4da2-84bd-9c0fffc77abd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:40.387308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3331ab-ebad-48b1-bae8-f53d29891333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:40.388150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3331ab-ebad-48b1-bae8-f53d29891333 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:40.388533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3331ab-ebad-48b1-bae8-f53d29891333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:40.388900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3331ab-ebad-48b1-bae8-f53d29891333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:40.389725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3331ab-ebad-48b1-bae8-f53d29891333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:40.391522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3331ab-ebad-48b1-bae8-f53d29891333 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:40.404312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1088/2190] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:18:40.408429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:40.420516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4be0-6433-4afc-ba97-8c9c79e38380 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:40.425751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:40.426637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:40.427210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:40.427501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] PATH_INFO: `/v3/projects/f31b7ff7d7544a43be9bc12dea90c978/users/5bc51f418c9244e39021aabc60179dd2/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:40.429546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31b7ff7d7544a43be9bc12dea90c978, user_id=5bc51f418c9244e39021aabc60179dd2, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:40.432429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:40.443897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1103/2191] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:18:40 2022] PUT /identity/v3/projects/f31b7ff7d7544a43be9bc12dea90c978/users/5bc51f418c9244e39021aabc60179dd2/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:18:46.746255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:46.746826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:46.746826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:46.780264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] MFA Rules not processed for user `5bc51f418c9244e39021aabc60179dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:46.781717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:46.879253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1089/2192] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:18:46.892472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:46.897225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:47.055787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:18:47.058120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:47.066344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a902-df0f-40d0-8263-33843fa91be5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:47.073060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb83a6-3521-4dd3-92a6-23beee16379a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:47.073744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb83a6-3521-4dd3-92a6-23beee16379a service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:47.076999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb83a6-3521-4dd3-92a6-23beee16379a service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:47.076999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb83a6-3521-4dd3-92a6-23beee16379a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:47.158502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb83a6-3521-4dd3-92a6-23beee16379a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:47.160450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb83a6-3521-4dd3-92a6-23beee16379a service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:47.174120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1104/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:18:47.196768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a35b8-ee50-413c-bf91-122a5cc3bbe2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:18:47.205556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:18:47.206231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:47.206592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:47.206785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:47.307467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:18:47.309280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:18:47.322237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1090/2194] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:18:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:18:50.222273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:18:50.222740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:18:50.222843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:18:50.241996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] MFA Rules not processed for user `af5972d049c243b48d0a59a7d4028273`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:18:50.243258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:18:50.250905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1105/2195] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:07.403104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:07.467020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f19f4c-52d6-46ad-b571-5d4d474e4fdb service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:07.471511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:07.472373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:07.472654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:07.472933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] PATH_INFO: `/v3/users/cd77ccd4aedc4fad9fb75fb2f358d859` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:07.474110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd77ccd4aedc4fad9fb75fb2f358d859)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:07.476055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:07.648603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd77ccd4aedc4fad9fb75fb2f358d859'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:07.649466 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd77ccd4aedc4fad9fb75fb2f358d859'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:07.661485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd77ccd4aedc4fad9fb75fb2f358d859'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:07.662134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd77ccd4aedc4fad9fb75fb2f358d859'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:07.736229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd77ccd4aedc4fad9fb75fb2f358d859'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:07.751047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1091/2196] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:19:07 2022] DELETE /identity/v3/users/cd77ccd4aedc4fad9fb75fb2f358d859 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:08.012214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:08.023265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0a85a-3362-4653-b031-72995b6bd4c3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:08.083100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:08.084852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:08.085148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:08.085427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] PATH_INFO: `/v3/projects/4b68a11882a6412eb56fce7c38668928` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:08.087909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b68a11882a6412eb56fce7c38668928)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:08.089851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:08.194041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b68a11882a6412eb56fce7c38668928', 'request_id': 'req-bfee9b57-8c73-4432-a42a-108df109f053'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.262007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b68a11882a6412eb56fce7c38668928', 'request_id': 'req-bfee9b57-8c73-4432-a42a-108df109f053'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.268434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b68a11882a6412eb56fce7c38668928', 'request_id': 'req-bfee9b57-8c73-4432-a42a-108df109f053'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.283543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] The token cache is being invalidate because project 4b68a11882a6412eb56fce7c38668928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:19:08.284020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.285002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.287530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1106/2197] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:19:08 2022] DELETE /identity/v3/projects/4b68a11882a6412eb56fce7c38668928 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:19:08.292468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:08.293882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:08.307083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792b625-a356-4323-bdf7-37e2ef54128b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:08.369203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:08.370078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:08.370382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:08.370680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] PATH_INFO: `/v3/users/0914d75f01294f45ac9ca44f372b87bc` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:08.371893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0914d75f01294f45ac9ca44f372b87bc)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:08.373860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:08.544733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0914d75f01294f45ac9ca44f372b87bc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.546252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0914d75f01294f45ac9ca44f372b87bc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.557056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0914d75f01294f45ac9ca44f372b87bc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.557698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0914d75f01294f45ac9ca44f372b87bc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.604785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5acc2b1f-0479-4fc7-a800-d7a7b7940c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0914d75f01294f45ac9ca44f372b87bc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:08.618364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1092/2198] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:19:08 2022] DELETE /identity/v3/users/0914d75f01294f45ac9ca44f372b87bc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:08.875527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:08.880742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:08.892979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee9b57-8c73-4432-a42a-108df109f053 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:08.953308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:08.954172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:08.954459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:08.954742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] PATH_INFO: `/v3/projects/b15b0b40065e4ef7b99f1c76394cb099` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:08.955978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15b0b40065e4ef7b99f1c76394cb099)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:08.958179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.051173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15b0b40065e4ef7b99f1c76394cb099', 'request_id': 'req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:09.107386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15b0b40065e4ef7b99f1c76394cb099', 'request_id': 'req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:09.113577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15b0b40065e4ef7b99f1c76394cb099', 'request_id': 'req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:09.125918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] The token cache is being invalidate because project b15b0b40065e4ef7b99f1c76394cb099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:19:09.126136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:09.126793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4b85f252-f0b6-42e0-a7a3-3e1b4530e0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:09.128362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1107/2199] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:19:08 2022] DELETE /identity/v3/projects/b15b0b40065e4ef7b99f1c76394cb099 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:09.133363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.133659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.133942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.151300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:09.152490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:09.213821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1093/2200] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:09.221502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.221789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.222067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.243215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:09.244991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:09.252258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1108/2201] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:09.256572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.266203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51948-8bb5-41e5-a7bb-471b1187eed3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.270892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.271586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.271874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.272157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.272887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:19:09.273197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.275587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.287184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1094/2202] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:19:09.291950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.301071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371777-7907-4542-a2a4-29c04b6ace99 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.306979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.307652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.308233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.308356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.309028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.310944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.424834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1109/2203] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:19:09 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:19:09.431492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.441910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f4547-d0f6-4962-aa56-3f9707dbecdc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.500463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.501135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.501417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.501692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.502377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.504306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.616091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1095/2204] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:19:09 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:19:09.620317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.630719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c475-b29b-46c0-81eb-01b4d0d51c7b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.638977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.638977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.638977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.638977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.644907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.644907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.650721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1110/2205] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:19:09.654643 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.665205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ba27-b959-4cd2-a179-19324931858b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.669813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf070a-6913-4868-a6ee-073eb13e0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.670470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf070a-6913-4868-a6ee-073eb13e0831 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.670839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf070a-6913-4868-a6ee-073eb13e0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.671286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf070a-6913-4868-a6ee-073eb13e0831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.672059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf070a-6913-4868-a6ee-073eb13e0831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.673666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf070a-6913-4868-a6ee-073eb13e0831 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.684368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1096/2206] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:19:09.688341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.698782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38447ed0-fb1b-4788-ba72-8572c8797d42 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.703457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.704419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.704703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.704981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] PATH_INFO: `/v3/projects/7a9a464c2e874b73978bbb20d663a8df/users/c9d5b42670e949658ab85f90cdd949c1/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.720800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9a464c2e874b73978bbb20d663a8df, user_id=c9d5b42670e949658ab85f90cdd949c1, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.723552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:09.801254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1111/2207] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:19:09 2022] PUT /identity/v3/projects/7a9a464c2e874b73978bbb20d663a8df/users/c9d5b42670e949658ab85f90cdd949c1/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:09.809932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.810226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.810513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.838391 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] MFA Rules not processed for user `c9d5b42670e949658ab85f90cdd949c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:09.839677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:09.904086 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1097/2208] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:09.915032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:09.916719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:09.980877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90633e-fa22-4c9b-8f3f-d6c710baec73 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:09.984695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6bab2-e870-4c27-a2be-42e82681ec23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:09.985491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6bab2-e870-4c27-a2be-42e82681ec23 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:09.985780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6bab2-e870-4c27-a2be-42e82681ec23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:09.986066 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6bab2-e870-4c27-a2be-42e82681ec23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:09.994673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6bab2-e870-4c27-a2be-42e82681ec23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:09.996172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6bab2-e870-4c27-a2be-42e82681ec23 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:10.006011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1112/2209] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:19:10.025970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:10.087910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54e71-1356-4f82-a5da-5fc4f81044cc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:10.092708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:10.093572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:10.093852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:10.094123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] PATH_INFO: `/v3/users/c9d5b42670e949658ab85f90cdd949c1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:10.095353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d5b42670e949658ab85f90cdd949c1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:10.097274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:10.270021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d5b42670e949658ab85f90cdd949c1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:10.270708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d5b42670e949658ab85f90cdd949c1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:10.282794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d5b42670e949658ab85f90cdd949c1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:10.283523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d5b42670e949658ab85f90cdd949c1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:10.371254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d5b42670e949658ab85f90cdd949c1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:10.386197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1098/2210] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:19:10 2022] DELETE /identity/v3/users/c9d5b42670e949658ab85f90cdd949c1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:10.390658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:10.391263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:10.391263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:10.408781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:10.409966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:10.472508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1113/2211] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:10.483165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:10.484614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:10.542560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9df3fd-7c0f-43e6-963f-4027c2a4aa16 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:10.546300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5825af-ae8d-4515-a93b-e5016198519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:10.546951 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5825af-ae8d-4515-a93b-e5016198519c service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:10.547273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5825af-ae8d-4515-a93b-e5016198519c service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:10.547549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5825af-ae8d-4515-a93b-e5016198519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:10.557767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5825af-ae8d-4515-a93b-e5016198519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:10.559235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5825af-ae8d-4515-a93b-e5016198519c service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:10.569272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1099/2212] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:19:10.955410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:10.956893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:10.969142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a4f04-218e-4824-8229-d3ef0a18324e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:10.974362 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:10.975229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:10.975512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:10.975793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] PATH_INFO: `/v3/projects/7a9a464c2e874b73978bbb20d663a8df` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:10.978627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9a464c2e874b73978bbb20d663a8df)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:10.981809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.097984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9a464c2e874b73978bbb20d663a8df', 'request_id': 'req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:11.170891 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9a464c2e874b73978bbb20d663a8df', 'request_id': 'req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:11.177087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9a464c2e874b73978bbb20d663a8df', 'request_id': 'req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:11.188596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] The token cache is being invalidate because project 7a9a464c2e874b73978bbb20d663a8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:19:11.188893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:11.189585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca99a7d5-203c-45bf-aad3-35c9c6b852e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:11.194546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1114/2213] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:19:10 2022] DELETE /identity/v3/projects/7a9a464c2e874b73978bbb20d663a8df => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:11.198350 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.198804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.198919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.217483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:11.218696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:11.280941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1100/2214] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:11.289819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.290185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.290582 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.310289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:11.311529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:11.319634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1115/2215] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:11.325599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.335822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9acf3-fc33-4ad5-813f-11978d8884f3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:11.341634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:11.342523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.342672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.342962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.348671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:19:11.348671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:11.348671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.359044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1101/2216] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:19:11.363887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.373249 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04221b0c-13a6-4add-902a-a374989de1f9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:11.377993 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:11.379297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.379297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.379297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.379912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:11.381799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.447104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1116/2217] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:19:11 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:19:11.451541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.461395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a63e-b059-40b3-acb0-2438e1d07216 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:11.519686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:11.520372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.520656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.520938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.521636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:11.523592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.601984 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1102/2218] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:19:11 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:19:11.603815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.614037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566725-2ad6-42b6-9c19-62cc350cf694 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:11.619763 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:11.620466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.620745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.621017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.621744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:11.623390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.635339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1117/2219] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:19:11.639657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.649789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98627123-2f26-4905-8db9-84696dd01148 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:11.654558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ffd82-eb07-4524-8c50-e5735af9247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:11.655319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ffd82-eb07-4524-8c50-e5735af9247e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.655610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ffd82-eb07-4524-8c50-e5735af9247e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.655892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ffd82-eb07-4524-8c50-e5735af9247e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.656620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ffd82-eb07-4524-8c50-e5735af9247e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:11.658216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ffd82-eb07-4524-8c50-e5735af9247e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.668324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1103/2220] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:19:11.672568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.683278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eb801-aadf-4c3f-a968-1d0e221af5f1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:11.687907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:11.688767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.689047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.689322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] PATH_INFO: `/v3/projects/d5b76f8203c64cf99f512979a53a6cbf/users/a5bb5c05c0b04ed6892495675185ecd4/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.704519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b76f8203c64cf99f512979a53a6cbf, user_id=a5bb5c05c0b04ed6892495675185ecd4, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:11.707216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:11.857425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1118/2221] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:19:11 2022] PUT /identity/v3/projects/d5b76f8203c64cf99f512979a53a6cbf/users/a5bb5c05c0b04ed6892495675185ecd4/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:11.867740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:11.868556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:11.868848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:11.895765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] MFA Rules not processed for user `a5bb5c05c0b04ed6892495675185ecd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:11.896995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:11.960887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1104/2222] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:11.974841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:11.976629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:12.033422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f637e-bc4f-44b7-963f-a3417e8c869e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:12.037398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:12.038104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:12.038388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:12.038665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:12.049175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:12.050609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:12.061721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1119/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:19:39.130124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:39.140955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:39.224400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbc684-fcc7-47b1-9bb1-1198345abe87 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:39.229903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:39.233458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:39.233458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:39.233458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:39.233458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:39.245317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:39.248377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:39.262161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1105/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:19:50.227674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:50.229089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:50.294793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa6307-b26e-43d0-bf90-0e01836bfde5 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:50.301380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:50.302256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:50.302537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:50.302886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] PATH_INFO: `/v3/users/ea79bf0354924adbb93145d7c9ced99b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:50.304481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea79bf0354924adbb93145d7c9ced99b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:50.306009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:50.413549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:50.423858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b21e0-e210-4315-8932-4180e8eb472f service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:50.428321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:50.429176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:50.429458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:50.429733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] PATH_INFO: `/v3/users/a5bb5c05c0b04ed6892495675185ecd4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:50.430905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bb5c05c0b04ed6892495675185ecd4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:50.432854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:50.480131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea79bf0354924adbb93145d7c9ced99b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.491950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea79bf0354924adbb93145d7c9ced99b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.492665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea79bf0354924adbb93145d7c9ced99b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.493269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea79bf0354924adbb93145d7c9ced99b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.540819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c87e1ec9-e9a3-4ba7-bbb5-29b712ece70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea79bf0354924adbb93145d7c9ced99b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.553887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1120/2225] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:19:50 2022] DELETE /identity/v3/users/ea79bf0354924adbb93145d7c9ced99b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:50.558240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:50.558527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:50.558804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:50.576779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:50.579219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:50.606122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bb5c05c0b04ed6892495675185ecd4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.607040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bb5c05c0b04ed6892495675185ecd4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.620224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bb5c05c0b04ed6892495675185ecd4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.620440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bb5c05c0b04ed6892495675185ecd4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.642538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1121/2226] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:19:50.652548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:50.654178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:50.695558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d4ee5e13-4bb4-40c6-b687-07c9dea05e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bb5c05c0b04ed6892495675185ecd4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:50.709568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1106/2227] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:19:50 2022] DELETE /identity/v3/users/a5bb5c05c0b04ed6892495675185ecd4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:19:50.713500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9160fc-852c-4d58-b5b5-8722848f7422 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:50.714333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:50.714621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:50.714894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:50.733822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:50.735591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:50.765786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:50.766476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:50.766753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:50.767052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:50.807581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1107/2228] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:50.817119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:50.819044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:50.831608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bffacf-217f-48b7-bdac-f3f219ef2946 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:50.835097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:50.835314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:50.836437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:50.836437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:50.836652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:50.836734 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:50.846373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:50.847244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1122/2229] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:19:50.847841 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:50.858233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1108/2230] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:19:51.331726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:51.332224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:51.333319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:51.333651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:51.346609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01873-c800-42a6-b1b8-2c6a3f4997d8 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:51.351787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:51.352663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.352949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.353222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] PATH_INFO: `/v3/projects/6bc12faa457f4ea9a4ecd0da053e702f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.355130 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc12faa457f4ea9a4ecd0da053e702f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:51.357101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:51.361364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb129-2ad9-4f4d-aba6-13aa5896d03a service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:51.368304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:51.369236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.369666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.369973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] PATH_INFO: `/v3/projects/d5b76f8203c64cf99f512979a53a6cbf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.371270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b76f8203c64cf99f512979a53a6cbf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:51.375142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:51.451016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc12faa457f4ea9a4ecd0da053e702f', 'request_id': 'req-8a491ae6-b0e0-4536-8af6-d9fd832947dd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.472941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b76f8203c64cf99f512979a53a6cbf', 'request_id': 'req-19bdb3b9-dfae-4e55-97e6-eed572e53cba'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.518151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc12faa457f4ea9a4ecd0da053e702f', 'request_id': 'req-8a491ae6-b0e0-4536-8af6-d9fd832947dd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.524457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc12faa457f4ea9a4ecd0da053e702f', 'request_id': 'req-8a491ae6-b0e0-4536-8af6-d9fd832947dd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.536018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] The token cache is being invalidate because project 6bc12faa457f4ea9a4ecd0da053e702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:19:51.536310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.536970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a491ae6-b0e0-4536-8af6-d9fd832947dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.538519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1123/2231] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:19:51 2022] DELETE /identity/v3/projects/6bc12faa457f4ea9a4ecd0da053e702f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:51.543254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.543551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.543831 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.563463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:51.564063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b76f8203c64cf99f512979a53a6cbf', 'request_id': 'req-19bdb3b9-dfae-4e55-97e6-eed572e53cba'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.564668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:51.569946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b76f8203c64cf99f512979a53a6cbf', 'request_id': 'req-19bdb3b9-dfae-4e55-97e6-eed572e53cba'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.581976 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] The token cache is being invalidate because project d5b76f8203c64cf99f512979a53a6cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:19:51.582197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.582878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-19bdb3b9-dfae-4e55-97e6-eed572e53cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:19:51.584474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1109/2232] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:19:51 2022] DELETE /identity/v3/projects/d5b76f8203c64cf99f512979a53a6cbf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:51.630644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1124/2233] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:19:51.639447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.639851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.640140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.660479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:51.661719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:51.670125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1110/2234] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:51.675552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:51.686283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3cae3-6073-4309-b5f7-00d60be4f934 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:51.692407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:51.693096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.693380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.693658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.694409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:19:51.694719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:51.696456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:51.713639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1125/2235] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:19:51.714881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:51.725130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf388f2-f43b-4669-a11e-f998c732bb38 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:51.730407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:51.731445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.731445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.731662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.732377 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:51.735100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:51.829298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1111/2236] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:19:51 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:19:51.833574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:51.844561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c0941-bb1a-4bba-84e4-cb4728b383fd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:51.903935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:51.904613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.904897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.905190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.906333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:51.908484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:51.970134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1126/2237] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:19:51 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:19:51.977921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:51.986900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743830c-a195-4706-8b8e-74d3a339b74d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:51.992551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:51.993212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:51.993642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:51.993923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:51.995038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:51.996632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:52.011554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1112/2238] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:19:52.012931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:52.023471 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e432539-4018-4698-a239-fc78363996e6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:52.028543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a738735-c8b9-4ee2-bc21-76271c911019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:52.029557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738735-c8b9-4ee2-bc21-76271c911019 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:52.029915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738735-c8b9-4ee2-bc21-76271c911019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:52.031015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738735-c8b9-4ee2-bc21-76271c911019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:52.031926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a738735-c8b9-4ee2-bc21-76271c911019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:52.033750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a738735-c8b9-4ee2-bc21-76271c911019 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:52.047372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1127/2239] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:19:52.049681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:52.059891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6590-163c-445b-9b5e-f223d2de581b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:52.064918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:52.065826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:52.066116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:52.066395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] PATH_INFO: `/v3/projects/99509c351dba4de19d779318015be91a/users/440c7615f44645ae9525f2266e4abff9/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:52.082408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99509c351dba4de19d779318015be91a, user_id=440c7615f44645ae9525f2266e4abff9, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:52.085175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:52.160078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1113/2240] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:19:52 2022] PUT /identity/v3/projects/99509c351dba4de19d779318015be91a/users/440c7615f44645ae9525f2266e4abff9/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:19:52.170595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13fa73-2184-4a8d-a60b-a55d558169c4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:52.170901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13fa73-2184-4a8d-a60b-a55d558169c4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:52.171608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13fa73-2184-4a8d-a60b-a55d558169c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:52.204182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-db13fa73-2184-4a8d-a60b-a55d558169c4 None None] MFA Rules not processed for user `440c7615f44645ae9525f2266e4abff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:19:52.205529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db13fa73-2184-4a8d-a60b-a55d558169c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:52.270818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1128/2241] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:19:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:19:52.283384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:19:52.285116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:19:52.339864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811572d-a84f-4c2a-8e5d-a51fbacad5f3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:19:52.344007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:19:52.344565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:19:52.344846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:19:52.345117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:19:52.353689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:19:52.355138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:19:52.364592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1114/2242] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:19:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:20:03.693158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:03.693787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:03.693787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:03.759971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:03.761320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:03.843884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1129/2243] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:03.895214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:03.897574 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:03.988047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482bff-ab54-4d88-811f-a609e90d925c service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:03.993846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484cc35-163d-43e2-8fba-da61acae2cfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:03.994601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484cc35-163d-43e2-8fba-da61acae2cfd service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:03.994956 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484cc35-163d-43e2-8fba-da61acae2cfd service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:03.995322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484cc35-163d-43e2-8fba-da61acae2cfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:04.004114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484cc35-163d-43e2-8fba-da61acae2cfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:04.007288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484cc35-163d-43e2-8fba-da61acae2cfd service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:04.016130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1115/2244] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:20:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 18:20:04.298715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:04.391648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e593a5-4170-4376-a754-81a98c45d780 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:04.407781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:04.408686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:04.408965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:04.409239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] PATH_INFO: `/v3/users/440c7615f44645ae9525f2266e4abff9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:04.410487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440c7615f44645ae9525f2266e4abff9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:04.412769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:04.638400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440c7615f44645ae9525f2266e4abff9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:04.650798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440c7615f44645ae9525f2266e4abff9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:04.651678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440c7615f44645ae9525f2266e4abff9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:04.652397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440c7615f44645ae9525f2266e4abff9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:04.719019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440c7615f44645ae9525f2266e4abff9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:04.734685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1130/2245] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:20:04 2022] DELETE /identity/v3/users/440c7615f44645ae9525f2266e4abff9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:20:04.739599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:04.739977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:04.740955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:04.765300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:04.766666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:04.839949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1116/2246] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:04.846132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:04.847672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:04.947603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440276-2dea-46ac-8f44-4cc12213fd24 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:04.965142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4855c-2cd9-4f8b-b59a-7496b0560356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:04.968074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4855c-2cd9-4f8b-b59a-7496b0560356 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:04.968974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4855c-2cd9-4f8b-b59a-7496b0560356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:04.971350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4855c-2cd9-4f8b-b59a-7496b0560356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:04.997794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4855c-2cd9-4f8b-b59a-7496b0560356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:04.999935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4855c-2cd9-4f8b-b59a-7496b0560356 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:05.010967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1131/2247] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:20:05.425407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:05.426381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:05.439864 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b55e-2bb6-40fe-8aa6-ea31efc1abb9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:05.446950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:05.447857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:05.448323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:05.448603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] PATH_INFO: `/v3/projects/99509c351dba4de19d779318015be91a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:05.449936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99509c351dba4de19d779318015be91a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:05.452166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:05.589467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99509c351dba4de19d779318015be91a', 'request_id': 'req-ed10b461-6a9d-40ba-af54-9033eea85771'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:05.816756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99509c351dba4de19d779318015be91a', 'request_id': 'req-ed10b461-6a9d-40ba-af54-9033eea85771'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:05.824914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99509c351dba4de19d779318015be91a', 'request_id': 'req-ed10b461-6a9d-40ba-af54-9033eea85771'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:05.838473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] The token cache is being invalidate because project 99509c351dba4de19d779318015be91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:20:05.844789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:05.844789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ed10b461-6a9d-40ba-af54-9033eea85771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:20:05.844789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1117/2248] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:20:05 2022] DELETE /identity/v3/projects/99509c351dba4de19d779318015be91a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:20:05.847075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:05.847938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:05.848218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:05.869461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:05.870787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:05.934220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1132/2249] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:05.942264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:05.942568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:05.942858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:05.962425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:05.963700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:05.972088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1118/2250] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:20:05.976756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:05.987160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830975-0781-46dc-a4c3-59a9e8d49ab0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:05.994369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.012069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.012069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.012069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.012069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:20:06.012069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.012069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.012957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1133/2251] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:20:06.018801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:06.039166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d633d-99a1-4d3a-9275-b7b8c02a07b3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:06.045884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.046763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.046970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.051363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.051363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.051363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.117156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1119/2252] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:20:06 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:20:06.126689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:06.138134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6775c-de22-4fa7-81e9-b249c984a15d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:06.235963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.236731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.237079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.237492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.238192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.241635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.339221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1134/2253] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:20:06 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:20:06.341067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:06.374458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ddae2-5e5a-40a8-aee3-fdc3740d5f27 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:06.392592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.393533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.393823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.394104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.394853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.396579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.409492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1120/2254] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:20:06.413801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:06.432884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa110d-d676-4113-80d9-9bcb472e8bed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:06.439199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f4aee-c61e-46f5-8f6f-bc864875b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.440397 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4aee-c61e-46f5-8f6f-bc864875b50d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.440796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4aee-c61e-46f5-8f6f-bc864875b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.441190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4aee-c61e-46f5-8f6f-bc864875b50d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.442124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4aee-c61e-46f5-8f6f-bc864875b50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.444820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4aee-c61e-46f5-8f6f-bc864875b50d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.459783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1135/2255] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:20:06.466804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:06.477498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66961-265e-4912-a646-8a66fe6637b2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:06.483938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.484839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.485124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.485405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] PATH_INFO: `/v3/projects/b773343d1a8d4e6889bb80f938a389a4/users/a4607ae490bb491ba40b13a86ec43f1a/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.508142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b773343d1a8d4e6889bb80f938a389a4, user_id=a4607ae490bb491ba40b13a86ec43f1a, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.510960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.622362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1121/2256] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:20:06 2022] PUT /identity/v3/projects/b773343d1a8d4e6889bb80f938a389a4/users/a4607ae490bb491ba40b13a86ec43f1a/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:20:06.627432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.627965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.628465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.647480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:06.648822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:06.710162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1136/2257] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:20:06.719442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:06.721129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:06.783443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8b4b6-8ed8-4b12-8dfe-e10b36efdbbc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:06.787181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9297f9d-bde8-4ad5-ba5e-f81544d48a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:06.788647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297f9d-bde8-4ad5-ba5e-f81544d48a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:06.788935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297f9d-bde8-4ad5-ba5e-f81544d48a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:06.789217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297f9d-bde8-4ad5-ba5e-f81544d48a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:06.800519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9297f9d-bde8-4ad5-ba5e-f81544d48a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:06.802019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9297f9d-bde8-4ad5-ba5e-f81544d48a8d service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:06.814616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1122/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:20:07.240421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:07.261011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab5f25-6150-4ac8-b4d9-b86d86efa159 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:07.270018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:07.272390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:07.272390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:07.272390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:07.274015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:07.410792 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:07.412807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:07.424031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1137/2259] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:20:16.439389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:16.440412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:16.440905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:16.477111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] MFA Rules not processed for user `a4607ae490bb491ba40b13a86ec43f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:16.478437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:16.567759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1123/2260] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:16.569639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:16.579824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abe683-1bea-41bb-aaf5-f081ef2d0141 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:16.584532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:16.585204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:16.585491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:16.585767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:16.586462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:16.588430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:16.876687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1138/2261] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:20:16 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:20:16.880793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:16.891735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba02c0f-4433-43f5-9058-0a9ef32a90d5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:16.953731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:16.954783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:16.955140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:16.955477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:16.956232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:16.958295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:17.054224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1124/2262] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:20:16 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:20:17.055487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:17.068383 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf195-489b-445d-909c-6cd2688b8451 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:17.080933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:17.081753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:17.082156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:17.082558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:17.083432 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:17.085837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:17.098075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1139/2263] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:20:17.103190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:17.114063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858844-6fdb-4925-8b7c-397b7cc45f14 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:17.121525 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:17.122423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:17.122705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:17.122981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] PATH_INFO: `/v3/projects/d360a244203f4e9589615e72fc2747de/users/b24c225125164eeab8c44e4c3b6b500e/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:17.149520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d360a244203f4e9589615e72fc2747de, user_id=b24c225125164eeab8c44e4c3b6b500e, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:17.152506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:17.219434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1125/2264] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:20:17 2022] PUT /identity/v3/projects/d360a244203f4e9589615e72fc2747de/users/b24c225125164eeab8c44e4c3b6b500e/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:20:17.224093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:17.238296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f643-609d-4c8f-94a3-5db4062152d4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:17.310278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a9ce2-1f68-4d1e-87c2-9b4d026258d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:17.310977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9ce2-1f68-4d1e-87c2-9b4d026258d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:17.311280 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9ce2-1f68-4d1e-87c2-9b4d026258d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:17.311604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9ce2-1f68-4d1e-87c2-9b4d026258d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:17.312490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a9ce2-1f68-4d1e-87c2-9b4d026258d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:17.314434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a9ce2-1f68-4d1e-87c2-9b4d026258d7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:17.327455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1140/2265] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:20:17.331415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:17.345684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e61b4-e2be-4f12-9a2d-7441196248f0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:17.351571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:17.356126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:17.356633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:17.356918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] PATH_INFO: `/v3/projects/d360a244203f4e9589615e72fc2747de/users/b24c225125164eeab8c44e4c3b6b500e/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:17.359088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d360a244203f4e9589615e72fc2747de, user_id=b24c225125164eeab8c44e4c3b6b500e, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:17.361767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:17.383440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1126/2266] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:20:17 2022] PUT /identity/v3/projects/d360a244203f4e9589615e72fc2747de/users/b24c225125164eeab8c44e4c3b6b500e/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:20:23.735037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d2390-d05f-4e9f-ab22-5cf277cf382b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:23.735037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d2390-d05f-4e9f-ab22-5cf277cf382b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:23.735037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d2390-d05f-4e9f-ab22-5cf277cf382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:23.744251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7d7d2390-d05f-4e9f-ab22-5cf277cf382b None None] MFA Rules not processed for user `b24c225125164eeab8c44e4c3b6b500e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:23.748002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7d7d2390-d05f-4e9f-ab22-5cf277cf382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:23.827391 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1141/2267] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:23.840058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:23.841739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:23.921902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81ebb0-5b36-42d1-ab2a-d5cb26af871c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:23.925628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:23.926272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:23.926553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:23.926828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:23.999740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:24.001417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:24.028768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1127/2268] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:20:24.343998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ff8d4-9020-4a2c-b7bb-38ce522760b3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:24.344311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ff8d4-9020-4a2c-b7bb-38ce522760b3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:24.344586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ff8d4-9020-4a2c-b7bb-38ce522760b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:24.363141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c08ff8d4-9020-4a2c-b7bb-38ce522760b3 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:24.365701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c08ff8d4-9020-4a2c-b7bb-38ce522760b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:24.425068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1142/2269] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:24.438568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:24.440363 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:24.525117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c95b5-9546-4e4b-9ac1-6ce40d30eb80 service glance] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:24.530596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdabd1-bbeb-43ce-a785-6f10816b4c2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:24.531253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdabd1-bbeb-43ce-a785-6f10816b4c2e service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:24.531781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdabd1-bbeb-43ce-a785-6f10816b4c2e service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:24.532065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdabd1-bbeb-43ce-a785-6f10816b4c2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:24.541104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdabd1-bbeb-43ce-a785-6f10816b4c2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:24.542742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdabd1-bbeb-43ce-a785-6f10816b4c2e service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:24.551914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1128/2270] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:20:24.564630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28453c2-4b63-4ee1-a8d7-6627b8ac0788 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:24.564920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28453c2-4b63-4ee1-a8d7-6627b8ac0788 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:24.565198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28453c2-4b63-4ee1-a8d7-6627b8ac0788 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:24.566548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1143/2271] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:20:24.574009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62871-13c4-4942-996d-08a66a747db2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:24.581772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62871-13c4-4942-996d-08a66a747db2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:24.581772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62871-13c4-4942-996d-08a66a747db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:24.616096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-79f62871-13c4-4942-996d-08a66a747db2 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:24.617840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-79f62871-13c4-4942-996d-08a66a747db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:24.686134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1129/2272] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:24.703996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28453c2-4b63-4ee1-a8d7-6627b8ac0788 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:24.723885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28453c2-4b63-4ee1-a8d7-6627b8ac0788 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:24.728076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d060b-1692-48ab-abe4-9e3cdd303e08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:24.730340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d060b-1692-48ab-abe4-9e3cdd303e08 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:24.731511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d060b-1692-48ab-abe4-9e3cdd303e08 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:24.731511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d060b-1692-48ab-abe4-9e3cdd303e08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:24.755331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d060b-1692-48ab-abe4-9e3cdd303e08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:24.756888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d060b-1692-48ab-abe4-9e3cdd303e08 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:24.775346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1144/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:20:24.994055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc5757-edc9-4883-be10-b67b20bf8623 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:24.994613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc5757-edc9-4883-be10-b67b20bf8623 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:24.994763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc5757-edc9-4883-be10-b67b20bf8623 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:24.996514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1130/2274] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:20:25.004035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634bb6d-22a6-43cf-b085-285d4595e28d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:25.004035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634bb6d-22a6-43cf-b085-285d4595e28d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:25.004035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634bb6d-22a6-43cf-b085-285d4595e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:25.037515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6634bb6d-22a6-43cf-b085-285d4595e28d None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:25.039705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6634bb6d-22a6-43cf-b085-285d4595e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:25.133268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc5757-edc9-4883-be10-b67b20bf8623 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:25.133514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1145/2275] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:25.147161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc5757-edc9-4883-be10-b67b20bf8623 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:25.152215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e82a4-e3f3-4765-892b-620639a9e546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:25.152948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e82a4-e3f3-4765-892b-620639a9e546 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:25.153305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e82a4-e3f3-4765-892b-620639a9e546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:25.153658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e82a4-e3f3-4765-892b-620639a9e546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:25.162383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e82a4-e3f3-4765-892b-620639a9e546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:25.164054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e82a4-e3f3-4765-892b-620639a9e546 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:25.172734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1131/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:20:25.297914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d93d-81ae-45a4-ac1a-eab6860b1d96 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:25.298551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d93d-81ae-45a4-ac1a-eab6860b1d96 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:25.299026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d93d-81ae-45a4-ac1a-eab6860b1d96 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:25.300588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1146/2277] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:20:25.311636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c7a8-bedd-40e3-9cf4-636ec0071c1b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:25.313347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c7a8-bedd-40e3-9cf4-636ec0071c1b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:25.314588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c7a8-bedd-40e3-9cf4-636ec0071c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:25.340742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-96d0c7a8-bedd-40e3-9cf4-636ec0071c1b None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:25.341745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-96d0c7a8-bedd-40e3-9cf4-636ec0071c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:25.355712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1132/2278] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:25.367079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970d93d-81ae-45a4-ac1a-eab6860b1d96 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:25.370219 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0970d93d-81ae-45a4-ac1a-eab6860b1d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:25.395626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970d93d-81ae-45a4-ac1a-eab6860b1d96 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:25.399560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:25.400220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:25.400639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:25.400917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:25.413662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:25.415256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:25.431800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1147/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:20:30.558123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ff7ca-1d63-42ae-8998-44458b9e6381 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:30.558702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ff7ca-1d63-42ae-8998-44458b9e6381 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:30.558702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ff7ca-1d63-42ae-8998-44458b9e6381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:30.580385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d95ff7ca-1d63-42ae-8998-44458b9e6381 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:30.580979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d95ff7ca-1d63-42ae-8998-44458b9e6381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:30.593487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1133/2280] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:30.605709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:30.622331 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084e77-ad4c-457b-ad3a-cc5ca78f19f6 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:30.628168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01924-baef-4f8b-88da-8127263d5a1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:30.628953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01924-baef-4f8b-88da-8127263d5a1e service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:30.629246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01924-baef-4f8b-88da-8127263d5a1e service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:30.629526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01924-baef-4f8b-88da-8127263d5a1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:30.639548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def01924-baef-4f8b-88da-8127263d5a1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:30.641155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def01924-baef-4f8b-88da-8127263d5a1e service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:30.651845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1148/2281] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:20:36.756784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:36.757338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:36.757338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:36.775876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] MFA Rules not processed for user `a4607ae490bb491ba40b13a86ec43f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:36.777089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:36.784271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1134/2282] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:20:49.651013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:49.652801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:49.652801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:49.671862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:20:49.673074 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:49.682879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1149/2283] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:20:49.696005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:49.711294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1e77b-a2d7-404d-9505-446f63a228dd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:49.716562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:49.717244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:49.717529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:49.717807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:49.726611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:49.729073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:49.737682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1135/2284] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:20:51.754669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:51.764348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b59606-fbb9-481e-9982-ec3c2860401a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:51.768634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:51.769696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:51.769803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:51.770101 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:51.772527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:51.816274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:51.817776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:51.845585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1150/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:20:55.302184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:20:55.311594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26ee1-6e9f-4ac5-8b64-2780cd422e4e service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:20:55.315758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:20:55.316422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:20:55.316704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:20:55.316978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:20:55.318772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:20:55.332988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:20:55.334491 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:20:55.346799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1136/2286] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:20:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:21:04.928881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:04.930569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:04.945309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc61cc-f241-4460-96a0-b3564c4df093 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:04.951128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:04.951670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:04.951959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:04.952237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:04.954732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:05.028244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:05.029871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:05.055245 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1151/2287] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:21:08.030803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:08.032268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:08.089498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9483c9-4f91-4e69-b3d8-6fad6674f615 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:08.093056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:08.093695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:08.093980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:08.094257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:08.096634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:08.154046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:08.155514 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d3544-5854-4e9a-b297-5592da82408e service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:08.165590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1137/2288] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:21:11.539038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:11.548348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adcac8-b26b-445f-95ec-c26fdadfa7f4 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:11.552893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:11.553520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:11.553798 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:11.554069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:11.555821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:11.564991 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:11.566423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:11.574247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1152/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:21:14.554106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:14.554617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:14.554879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:14.573345 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:21:14.574585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:14.582617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1138/2290] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:21:14.605451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:14.618172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67884-66f7-4379-9e6b-dd93aa59d226 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:14.623540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:14.624193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:14.624478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:14.625332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:14.633873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:14.635484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:14.643646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1153/2291] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:21:31.468480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:31.479065 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774f1b2-9f34-4b30-9497-ba1f4c4dd15d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:31.482646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:31.483321 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:31.483614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:31.483891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:31.493765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:31.495235 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:31.504805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1139/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:21:32.400643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:32.402042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:32.428716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe89b9-bde8-44d7-9486-169b2a273702 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:32.434354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:32.435435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:32.435435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:32.436143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:32.437655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:32.501405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:32.503466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:32.514309 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1154/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:21:33.745573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:33.762308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c33ce7-52da-4267-b5b6-2f0c19a241de service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:33.768492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:33.769470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:33.769470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:33.769780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:33.771765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:33.784348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:33.786183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade875-ec29-4137-b1f2-956b936c182f service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:33.798042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1140/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:21:37.486817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:21:37.500272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36322-02e7-48a0-836c-a9e7a3748b70 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:21:37.506575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:21:37.507548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:37.507901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:37.508394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:37.510335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:37.523956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:21:37.525839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264401b-1627-44ef-8283-2fe6349ad36d service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:21:37.538735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1155/2295] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:21:50.135288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:21:50.135817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:21:50.135917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:21:50.153484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] MFA Rules not processed for user `721476a70afb4d1095a89215f1016045`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:21:50.154680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:21:50.161601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1141/2296] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:22:25.451183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:22:25.451710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:22:25.451710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:22:25.468348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] MFA Rules not processed for user `480f3fa6c37b4d018ffa5803027d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:22:25.469452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:25.523748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1156/2297] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:22:25.833991 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:22:25.843458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eecba-bd01-4808-8df9-0279a447a72e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:22:25.847801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:22:25.855151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:22:25.855151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:22:25.855151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:22:25.855151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:25.861532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:22:25.863066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:22:25.871131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1142/2298] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:22:26.299230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:22:26.300618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:26.396855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c7c6-ea27-4368-937d-1ba5af3270e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:22:26.402144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:22:26.402808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:22:26.403115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:22:26.403400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:22:26.405178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:26.418046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:22:26.419666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e9b57-d3fe-4e12-9bc5-1855679cc3fb service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:22:26.430188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1157/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:22:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:22:34.452714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:22:34.461035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65cefd-cc20-4de7-8dc6-95c5ae0ea9b8 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:22:34.464748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:22:34.465395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:22:34.465678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:22:34.465978 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:22:34.467936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:34.479782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:22:34.481312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:22:34.500702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1143/2300] 10.222.0.23 () {60 vars in 1396 bytes} [Wed May 4 18:22:34 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:22:35.273825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5172-11d1-417e-bc08-fb74fe091fe7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:22:35.274479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5172-11d1-417e-bc08-fb74fe091fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:22:35.274837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5172-11d1-417e-bc08-fb74fe091fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:22:35.295784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7f9f5172-11d1-417e-bc08-fb74fe091fe7 None None] MFA Rules not processed for user `ba28b51976a54c89ac3beb5394b1ec76`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:22:35.297234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7f9f5172-11d1-417e-bc08-fb74fe091fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:35.306714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1158/2301] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:22:37.272222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:22:37.285285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b7bf7-475f-45cf-8618-2fc7e15b7b41 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:22:37.291332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:22:37.293756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:22:37.293756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:22:37.293756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:22:37.294308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:22:37.306757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:22:37.308370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:22:37.319733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1144/2302] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:22:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:23:17.817887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:17.818426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:17.818426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:17.836877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] MFA Rules not processed for user `994dc4b8b3e047ddbe501ff74f3c709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:17.838087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:17.845449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1159/2303] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:28.736707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:28.745993 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55f25-8325-4ba9-97a2-b3140d437ea1 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:28.749771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:28.750405 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:28.750688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:28.750964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:28.752872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:28.816959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:28.818388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:28.829192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1145/2304] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:23:32.943170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:32.945149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:32.959981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980546-e021-4881-be3e-6ea72c30db81 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:32.965220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:32.966159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:32.966459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:32.966930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] PATH_INFO: `/v3/users/721476a70afb4d1095a89215f1016045` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:32.968323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=721476a70afb4d1095a89215f1016045)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:32.970258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:33.143692 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721476a70afb4d1095a89215f1016045'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.156409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721476a70afb4d1095a89215f1016045'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.157141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721476a70afb4d1095a89215f1016045'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.157750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721476a70afb4d1095a89215f1016045'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.242606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c39af24d-9790-44ee-afb7-cc777a8405bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721476a70afb4d1095a89215f1016045'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.255596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1160/2305] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:23:32 2022] DELETE /identity/v3/users/721476a70afb4d1095a89215f1016045 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:23:33.555674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:33.568761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e77a5-3c78-4206-a6f0-b1633e68960b service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:33.628340 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:33.629215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:33.629506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:33.629781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] PATH_INFO: `/v3/projects/52f7ff6557334462979f9934251c2158` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:33.631026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f7ff6557334462979f9934251c2158)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:33.634021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:33.744386 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f7ff6557334462979f9934251c2158', 'request_id': 'req-929e6093-67c9-445c-a4c2-96f6da4fa298'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.822774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f7ff6557334462979f9934251c2158', 'request_id': 'req-929e6093-67c9-445c-a4c2-96f6da4fa298'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.828776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f7ff6557334462979f9934251c2158', 'request_id': 'req-929e6093-67c9-445c-a4c2-96f6da4fa298'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.840483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] The token cache is being invalidate because project 52f7ff6557334462979f9934251c2158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:23:33.840899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.841693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-929e6093-67c9-445c-a4c2-96f6da4fa298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:33.843501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1146/2306] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:23:33 2022] DELETE /identity/v3/projects/52f7ff6557334462979f9934251c2158 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:23:33.848732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:33.849192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:33.853577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:33.868621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:33.869963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:33.931895 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1161/2307] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:23:33.939916 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:33.940210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:33.940496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:33.959914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:33.961298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:33.969217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1147/2308] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:33.973494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:33.984283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55489e-3b89-4b16-98d6-8d2993b8c8dc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:33.989160 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:33.989821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:33.990124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:33.990507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:33.991392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:23:33.992545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:33.994284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.010137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1162/2309] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:23:34.011106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:34.020516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181cd4-92a1-4c56-bf18-651031f88da5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:34.025494 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:34.026152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.026439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.026718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.027599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:34.029503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.123866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1148/2310] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:23:34 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:23:34.125159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:34.135095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7377e7-213d-4c22-b22d-7b3d77529b4d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:34.191286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:34.191970 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.192259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.192548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.193246 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:34.195548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.261947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1163/2311] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:23:34 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:23:34.266008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:34.276819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2345649-9d43-4496-8a46-8d1f8fc83d19 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:34.281783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:34.282464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.282749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.283046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.283788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:34.285387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.296276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1149/2312] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:23:34.300296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:34.311548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60ab6-92e0-4862-9147-d11684fce400 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:34.316299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7640d-5b5e-4ba6-9f12-b30644c875c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:34.316986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7640d-5b5e-4ba6-9f12-b30644c875c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.317287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7640d-5b5e-4ba6-9f12-b30644c875c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.317559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7640d-5b5e-4ba6-9f12-b30644c875c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.318426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7640d-5b5e-4ba6-9f12-b30644c875c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:34.320851 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7640d-5b5e-4ba6-9f12-b30644c875c9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.334261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1164/2313] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:23:34.335446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:34.348142 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290d1c-0315-4e01-9f14-b6a4ba667ef2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:34.350781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:34.351791 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.352103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.352379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] PATH_INFO: `/v3/projects/df22be1780744366a82d3728ba36358b/users/20710ceddb924d30b6b33e831d7e8d1a/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.367709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df22be1780744366a82d3728ba36358b, user_id=20710ceddb924d30b6b33e831d7e8d1a, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:34.370437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.471434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1150/2314] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:23:34 2022] PUT /identity/v3/projects/df22be1780744366a82d3728ba36358b/users/20710ceddb924d30b6b33e831d7e8d1a/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:23:34.475990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.476775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.477049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.513110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] MFA Rules not processed for user `20710ceddb924d30b6b33e831d7e8d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:34.514461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:34.586176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1165/2315] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:34.594105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:34.596329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:34.686473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0e95e-7271-49fe-a583-c47c97be35f4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:34.692753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4439d3-e9d9-4fe0-850f-b5ff29d289cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:34.693663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4439d3-e9d9-4fe0-850f-b5ff29d289cf service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:34.694040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4439d3-e9d9-4fe0-850f-b5ff29d289cf service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:34.694414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4439d3-e9d9-4fe0-850f-b5ff29d289cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:34.705335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4439d3-e9d9-4fe0-850f-b5ff29d289cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:34.706942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4439d3-e9d9-4fe0-850f-b5ff29d289cf service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:34.723208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1151/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:23:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:23:46.058029 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:46.118020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74416c6f-eeb7-400f-ad04-ee51f3667be4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:46.123159 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:46.124025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:46.124305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:46.124578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] PATH_INFO: `/v3/users/20710ceddb924d30b6b33e831d7e8d1a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:46.125767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20710ceddb924d30b6b33e831d7e8d1a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:46.127718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:46.336936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20710ceddb924d30b6b33e831d7e8d1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:46.349795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20710ceddb924d30b6b33e831d7e8d1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:46.350556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20710ceddb924d30b6b33e831d7e8d1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:46.351204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20710ceddb924d30b6b33e831d7e8d1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:46.438723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20710ceddb924d30b6b33e831d7e8d1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:46.452184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1166/2317] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:23:46 2022] DELETE /identity/v3/users/20710ceddb924d30b6b33e831d7e8d1a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:23:46.456988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:46.457507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:46.457623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:46.474413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:46.476323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:46.536083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1152/2318] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:46.546555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:46.547974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:46.605295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e497607-9976-4189-8a65-fc8dfa13792f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:46.609766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc959a-a119-43d6-9113-eca4c95ca9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:46.610423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc959a-a119-43d6-9113-eca4c95ca9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:46.610704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc959a-a119-43d6-9113-eca4c95ca9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:46.610978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc959a-a119-43d6-9113-eca4c95ca9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:46.620382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc959a-a119-43d6-9113-eca4c95ca9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:46.621845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc959a-a119-43d6-9113-eca4c95ca9e2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:46.632465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1167/2319] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:23:47.046854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.049533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:47.062084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53891a9-20c9-424b-a07a-62f0415de178 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.066691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.067577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.067887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.068158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] PATH_INFO: `/v3/projects/df22be1780744366a82d3728ba36358b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.069366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df22be1780744366a82d3728ba36358b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.071302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.185666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df22be1780744366a82d3728ba36358b', 'request_id': 'req-36667b05-930d-423a-a49c-2f06d1ded567'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:47.256195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df22be1780744366a82d3728ba36358b', 'request_id': 'req-36667b05-930d-423a-a49c-2f06d1ded567'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:47.262236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df22be1780744366a82d3728ba36358b', 'request_id': 'req-36667b05-930d-423a-a49c-2f06d1ded567'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:47.274308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] The token cache is being invalidate because project df22be1780744366a82d3728ba36358b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:23:47.274591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:47.275252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-36667b05-930d-423a-a49c-2f06d1ded567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:23:47.276802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1153/2320] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:23:47 2022] DELETE /identity/v3/projects/df22be1780744366a82d3728ba36358b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:23:47.283182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.283678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.283788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.302062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:47.302567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:47.360523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1168/2321] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:47.369242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.369529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.369806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.389252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:47.390435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:47.398246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1154/2322] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:47.402451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.412549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fb64d-f91a-42e8-aaac-2b75b5232e93 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.417406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.418049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.418329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.418602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.419399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:23:47.419706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.421300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.432709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1169/2323] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:23:47.437599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.446638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b44b4c-43eb-4434-a467-8d9589f5d539 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.451827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.452471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.452756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.453029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.453824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.455704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.532034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1155/2324] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:23:47 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:23:47.536329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.547440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc091-9c2f-45af-bc5b-0a1568402217 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.603816 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.604405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.604694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.604972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.605707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.607972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.702439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1170/2325] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:23:47 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:23:47.706743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.717699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc93c-c450-4d4e-a9be-c4f1c871119a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.722565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.726331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.726331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.726331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.726331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.726331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.736755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1156/2326] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:23:47.740770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.751655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0be7-08a8-4c17-ac30-506d7ddbde6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.756296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a351-eaae-42d4-9638-c4a2d220ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.756940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a351-eaae-42d4-9638-c4a2d220ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.757227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a351-eaae-42d4-9638-c4a2d220ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.757508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a351-eaae-42d4-9638-c4a2d220ab5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.758230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a351-eaae-42d4-9638-c4a2d220ab5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.759965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a351-eaae-42d4-9638-c4a2d220ab5d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.771091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1171/2327] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:23:47.775521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:47.785819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfff5cc-d3f4-4377-911e-7711c8059c8e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:47.790667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:47.791569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.791858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.792136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] PATH_INFO: `/v3/projects/87aea23c767843518ec8dbbf11a5ce22/users/37cca0d4db9c483fa52b548a9a67fbbc/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.807260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87aea23c767843518ec8dbbf11a5ce22, user_id=37cca0d4db9c483fa52b548a9a67fbbc, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:47.809998 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:47.896290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1157/2328] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:23:47 2022] PUT /identity/v3/projects/87aea23c767843518ec8dbbf11a5ce22/users/37cca0d4db9c483fa52b548a9a67fbbc/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:23:47.907938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:47.908224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:47.912141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:47.936028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] MFA Rules not processed for user `37cca0d4db9c483fa52b548a9a67fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:23:47.937269 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:47.999515 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1172/2329] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:23:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:23:48.010335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:48.012044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:23:48.068597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955d8a-42ee-42f0-b4c3-f268dfa2234b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:48.072333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c49732-1338-4cc2-a45d-eb908da17aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:48.072975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c49732-1338-4cc2-a45d-eb908da17aea service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:48.073258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c49732-1338-4cc2-a45d-eb908da17aea service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:48.073538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c49732-1338-4cc2-a45d-eb908da17aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:48.082427 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c49732-1338-4cc2-a45d-eb908da17aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:48.083927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c49732-1338-4cc2-a45d-eb908da17aea service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:23:48.093450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1158/2330] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:23:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:23:59.773693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:23:59.836240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a641eca-4960-4668-92e4-d30ac9c437d8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:23:59.840761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:23:59.841784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:23:59.842067 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:23:59.842343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] PATH_INFO: `/v3/users/37cca0d4db9c483fa52b548a9a67fbbc` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:23:59.843649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cca0d4db9c483fa52b548a9a67fbbc)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:23:59.845586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:00.041663 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cca0d4db9c483fa52b548a9a67fbbc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.053693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cca0d4db9c483fa52b548a9a67fbbc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.054800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cca0d4db9c483fa52b548a9a67fbbc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.055857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cca0d4db9c483fa52b548a9a67fbbc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.140137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cca0d4db9c483fa52b548a9a67fbbc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.152781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1173/2331] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:23:59 2022] DELETE /identity/v3/users/37cca0d4db9c483fa52b548a9a67fbbc => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:00.158148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:00.158777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:00.158777 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:00.176088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:00.177307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:00.237505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1159/2332] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:00.247138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:00.248558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:00.309660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea6f6-1e96-4985-b0d2-ad312a0b8b76 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:00.309660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e4077-254e-4131-aa09-75960b5b79ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:00.309660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e4077-254e-4131-aa09-75960b5b79ab service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:00.309660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e4077-254e-4131-aa09-75960b5b79ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:00.310155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e4077-254e-4131-aa09-75960b5b79ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:00.318793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e4077-254e-4131-aa09-75960b5b79ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:00.320294 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e4077-254e-4131-aa09-75960b5b79ab service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:00.329697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1174/2333] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:00.761810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:00.762797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:00.775380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb1b4-ece5-4107-9075-e34b365906a9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:00.780164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:00.780981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:00.781258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:00.781534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] PATH_INFO: `/v3/projects/87aea23c767843518ec8dbbf11a5ce22` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:00.782893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87aea23c767843518ec8dbbf11a5ce22)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:00.784886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:00.912740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87aea23c767843518ec8dbbf11a5ce22', 'request_id': 'req-611e5de0-5d52-431b-ad87-c23184e08ddd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.993051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87aea23c767843518ec8dbbf11a5ce22', 'request_id': 'req-611e5de0-5d52-431b-ad87-c23184e08ddd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:00.999913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87aea23c767843518ec8dbbf11a5ce22', 'request_id': 'req-611e5de0-5d52-431b-ad87-c23184e08ddd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:01.011322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] The token cache is being invalidate because project 87aea23c767843518ec8dbbf11a5ce22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:01.011611 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:01.012258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-611e5de0-5d52-431b-ad87-c23184e08ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:01.013938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1160/2334] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:00 2022] DELETE /identity/v3/projects/87aea23c767843518ec8dbbf11a5ce22 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:01.020148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.020646 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.020759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.038233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:01.039464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:01.098910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1175/2335] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:01.107872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.108166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.108449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.128785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:01.130022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:01.138066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1161/2336] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:01.148693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.158842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc71d35-fdb1-4aab-941c-f452a18441a1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.163757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.164396 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.164926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.165208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.165938 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:24:01.166248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.167979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.179961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1176/2337] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:24:01.184402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.194201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637d5e9-2807-4321-bc62-29148e180c63 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.199331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.200708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.200708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.200708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.201332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.204501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.290664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1162/2338] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:01 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:01.294685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.305194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012393e-29a8-49da-9bbc-ca32febe33e8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.359408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.360070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.360350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.360623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.361333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.363265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.482954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1177/2339] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:01 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:24:01.488106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.500763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788236-29ea-420e-abf0-56ff7d821ac4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.505692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.511197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.511197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.511197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.511197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.511197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.520068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1163/2340] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:01.524121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.534190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98697f-3fe8-4a8c-917c-51cd1248a396 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.538820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36515bf8-cc90-4fd5-b216-754862b9ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.539752 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36515bf8-cc90-4fd5-b216-754862b9ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.540045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36515bf8-cc90-4fd5-b216-754862b9ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.540324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36515bf8-cc90-4fd5-b216-754862b9ff2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.541060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36515bf8-cc90-4fd5-b216-754862b9ff2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.542616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36515bf8-cc90-4fd5-b216-754862b9ff2d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.554615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1178/2341] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:01.558655 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.569400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381816-d472-4967-a7c3-ac4bef3d803a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.574159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.575061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.575374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.575651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] PATH_INFO: `/v3/projects/6999b1a8c840435ba59e4c011dc0f21a/users/f0ad33ecff6945039176fcb2fcd77e83/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.590676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6999b1a8c840435ba59e4c011dc0f21a, user_id=f0ad33ecff6945039176fcb2fcd77e83, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.593511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.657160 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1164/2342] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:01 2022] PUT /identity/v3/projects/6999b1a8c840435ba59e4c011dc0f21a/users/f0ad33ecff6945039176fcb2fcd77e83/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:01.667738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.668032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.668312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.694573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] MFA Rules not processed for user `f0ad33ecff6945039176fcb2fcd77e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:01.695804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:01.758068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1179/2343] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:01.769354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:01.770932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:01.848901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72acf-e51c-41ea-bd37-129ea59e60d5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:01.854521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc59639-fd71-40c4-a52a-642af3eb31e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:01.855194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc59639-fd71-40c4-a52a-642af3eb31e8 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:01.855482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc59639-fd71-40c4-a52a-642af3eb31e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:01.855762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc59639-fd71-40c4-a52a-642af3eb31e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:01.864328 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc59639-fd71-40c4-a52a-642af3eb31e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:01.865909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc59639-fd71-40c4-a52a-642af3eb31e8 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:01.874919 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1165/2344] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:02.053211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:02.118655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b436d8-c017-4c48-ac6e-ab20e4e03158 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:02.123609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:02.124527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:02.124807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:02.125247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] PATH_INFO: `/v3/users/f0ad33ecff6945039176fcb2fcd77e83` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:02.126518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ad33ecff6945039176fcb2fcd77e83)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:02.128508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:02.306886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ad33ecff6945039176fcb2fcd77e83'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:02.322926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ad33ecff6945039176fcb2fcd77e83'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:02.324019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ad33ecff6945039176fcb2fcd77e83'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:02.324963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ad33ecff6945039176fcb2fcd77e83'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:02.383376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ad33ecff6945039176fcb2fcd77e83'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:02.406672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1180/2345] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:02 2022] DELETE /identity/v3/users/f0ad33ecff6945039176fcb2fcd77e83 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:02.411114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:02.411647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:02.411647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:02.429616 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:02.430821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:02.500042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1166/2346] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:02.509422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:02.511376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:02.575815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21685b-50db-47f4-966b-c508924edb3e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:02.580748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995cae-e9d6-4c7e-9530-8e06167c5fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:02.581412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995cae-e9d6-4c7e-9530-8e06167c5fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:02.581697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995cae-e9d6-4c7e-9530-8e06167c5fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:02.581978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995cae-e9d6-4c7e-9530-8e06167c5fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:02.593091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995cae-e9d6-4c7e-9530-8e06167c5fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:02.595162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995cae-e9d6-4c7e-9530-8e06167c5fd3 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:02.606241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1181/2347] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:03.051212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.052760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:03.067592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac14ba-bab6-49d6-8848-0db1ceccc909 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.072750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.074389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.074686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.075040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] PATH_INFO: `/v3/projects/6999b1a8c840435ba59e4c011dc0f21a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.076312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6999b1a8c840435ba59e4c011dc0f21a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.078883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.176820 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6999b1a8c840435ba59e4c011dc0f21a', 'request_id': 'req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:03.234271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6999b1a8c840435ba59e4c011dc0f21a', 'request_id': 'req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:03.240627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6999b1a8c840435ba59e4c011dc0f21a', 'request_id': 'req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:03.252276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] The token cache is being invalidate because project 6999b1a8c840435ba59e4c011dc0f21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:03.252568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:03.253224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01ea569c-bc1d-4c00-a03d-913a5a3e68f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:03.254981 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1167/2348] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:03 2022] DELETE /identity/v3/projects/6999b1a8c840435ba59e4c011dc0f21a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:03.260047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.260567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.260732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.278172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:03.280861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:03.339305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1182/2349] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:03.348300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.348619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.348872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.368413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:03.369649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:03.377975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1168/2350] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:03.382654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.392616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb8fb1-c02a-4eb7-9057-2546fbf5fcbb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.397196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.397846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.398129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.398407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.399173 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:24:03.399483 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.401073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.413088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1183/2351] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:24:03.417732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.427604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6171-6c34-4988-8ef7-b9dc20fa54da None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.432260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.432909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.433196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.433475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.434178 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.436117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.538826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1169/2352] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:03 2022] POST /identity/v3/projects => generated 361 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:03.543537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.553518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb1371-4502-4a80-80ce-cd963960aca2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.610371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.611069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.611355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.611631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.612353 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.614278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.736859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1184/2353] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:03 2022] POST /identity/v3/users => generated 281 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:03.741117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.751107 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981971-b41e-4cf5-b5c4-6085763d87f4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.756449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.756449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.756688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.756836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.757549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.759170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.770177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1170/2354] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:03.774312 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.785464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c1933-174c-497c-b263-c95199fd9e3b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.790516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33739-6266-4047-9df3-78e1338d8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.791210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33739-6266-4047-9df3-78e1338d8f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.791593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33739-6266-4047-9df3-78e1338d8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.791867 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33739-6266-4047-9df3-78e1338d8f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.792617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e33739-6266-4047-9df3-78e1338d8f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.794216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e33739-6266-4047-9df3-78e1338d8f6a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.804033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1185/2355] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:03.808255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:03.818397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d4d8e-d0c7-4829-ba62-32a9fc25082b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:03.822959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:03.823900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.824196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.824465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] PATH_INFO: `/v3/projects/6ca28fb5a99648a2b6e5dc5e2b4640ba/users/9c744c5b02c7452a8d8b95c783280069/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.839579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca28fb5a99648a2b6e5dc5e2b4640ba, user_id=9c744c5b02c7452a8d8b95c783280069, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:03.842223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:03.925663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1171/2356] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:03 2022] PUT /identity/v3/projects/6ca28fb5a99648a2b6e5dc5e2b4640ba/users/9c744c5b02c7452a8d8b95c783280069/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:24:03.938133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:03.938425 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:03.938706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:03.965708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] MFA Rules not processed for user `9c744c5b02c7452a8d8b95c783280069`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:03.966912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:04.029570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1186/2357] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:04.034294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.096115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0da315-aa4e-49e4-b0f0-04d30a5063c6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.100786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.101441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.101727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.102007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.102705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.104652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.188258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1172/2358] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:04 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:04.192512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.204451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f1e9-14b3-439f-a628-75a30265ba21 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.258627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.259326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.259614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.259894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.260575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.262495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.360179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1187/2359] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:04 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:04.364670 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.375661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492691-0231-4aff-9c86-1e1073477e4f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.380362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.381015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.381296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.381567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.382286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.383958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.395688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1173/2360] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:04.400090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.410143 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f86b8a-375a-43a6-8af4-d94799872bf5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.415125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.415930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.416214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.416488 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] PATH_INFO: `/v3/projects/f2338f564cf8444b84eaaf683a13ce45/users/f42975cc45114323bf9af95ef10ff581/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.431902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2338f564cf8444b84eaaf683a13ce45, user_id=f42975cc45114323bf9af95ef10ff581, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.434804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.531736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1188/2361] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:04 2022] PUT /identity/v3/projects/f2338f564cf8444b84eaaf683a13ce45/users/f42975cc45114323bf9af95ef10ff581/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:04.535704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.545926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d027fd-17e8-4449-9d3d-f7746286bb68 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.601187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04abd-e863-45e9-b0ae-086a67e7ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.601866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04abd-e863-45e9-b0ae-086a67e7ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.602127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04abd-e863-45e9-b0ae-086a67e7ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.602396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04abd-e863-45e9-b0ae-086a67e7ec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.603148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04abd-e863-45e9-b0ae-086a67e7ec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.604736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04abd-e863-45e9-b0ae-086a67e7ec6b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.614717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1174/2362] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:04.618834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.630980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd29d-5955-49aa-971c-e03700e55708 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.636147 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.637026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.637318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.637599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] PATH_INFO: `/v3/projects/f2338f564cf8444b84eaaf683a13ce45/users/f42975cc45114323bf9af95ef10ff581/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.640229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2338f564cf8444b84eaaf683a13ce45, user_id=f42975cc45114323bf9af95ef10ff581, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.643073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.653336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1189/2363] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:04 2022] PUT /identity/v3/projects/f2338f564cf8444b84eaaf683a13ce45/users/f42975cc45114323bf9af95ef10ff581/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:24:04.663714 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.664075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.664425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.691688 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] MFA Rules not processed for user `f42975cc45114323bf9af95ef10ff581`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:04.692878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:04.758047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1175/2364] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:04.769693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:04.771489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:04.828402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d7f5-6c18-4f12-94b3-8e6d21de21bf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:04.831987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:04.832626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:04.832908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:04.833180 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:04.842069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:04.844251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:04.853451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1190/2365] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:05.028590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:05.038722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666840db-251b-4753-a75a-0c6fc1112021 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:05.042457 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bc393-09d1-4509-9f03-58684b782c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:05.043131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bc393-09d1-4509-9f03-58684b782c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:05.043407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bc393-09d1-4509-9f03-58684b782c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:05.043678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bc393-09d1-4509-9f03-58684b782c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:05.099378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bc393-09d1-4509-9f03-58684b782c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:05.100887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bc393-09d1-4509-9f03-58684b782c3d service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:05.109926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1176/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:08.648783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:08.710878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b0ea-e0c8-4fde-916d-2d716f157536 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:08.715567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:08.716427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:08.716709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:08.716984 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] PATH_INFO: `/v3/users/9c744c5b02c7452a8d8b95c783280069` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:08.718190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c744c5b02c7452a8d8b95c783280069)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:08.720290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:08.944760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c744c5b02c7452a8d8b95c783280069'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:08.956695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c744c5b02c7452a8d8b95c783280069'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:08.957368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c744c5b02c7452a8d8b95c783280069'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:08.958000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c744c5b02c7452a8d8b95c783280069'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.021666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c744c5b02c7452a8d8b95c783280069'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.034377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1191/2367] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:08 2022] DELETE /identity/v3/users/9c744c5b02c7452a8d8b95c783280069 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:09.038974 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:09.039467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:09.039842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:09.056861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:09.058063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:09.115772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1177/2368] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:09.127574 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:09.128961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:09.185782 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ef634-2d95-4e14-b8f6-20727304f28b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:09.189613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:09.190270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:09.190553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:09.190828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:09.200244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:09.201705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:09.211467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1192/2369] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:09.641256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:09.642750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:09.654890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bebed-2f39-4d73-a9d4-24a1f702bcb3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:09.661249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:09.662180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:09.662467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:09.662742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] PATH_INFO: `/v3/projects/6ca28fb5a99648a2b6e5dc5e2b4640ba` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:09.663949 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca28fb5a99648a2b6e5dc5e2b4640ba)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:09.666323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:09.764315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca28fb5a99648a2b6e5dc5e2b4640ba', 'request_id': 'req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.844674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca28fb5a99648a2b6e5dc5e2b4640ba', 'request_id': 'req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.850449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca28fb5a99648a2b6e5dc5e2b4640ba', 'request_id': 'req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.861944 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] The token cache is being invalidate because project 6ca28fb5a99648a2b6e5dc5e2b4640ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:09.862232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.862877 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:09.864585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1178/2370] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:09 2022] DELETE /identity/v3/projects/6ca28fb5a99648a2b6e5dc5e2b4640ba => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:09.868930 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:09.879378 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d55528-c9ce-4c38-8a37-71a37a6fa2a7 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:09.938392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:09.939330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:09.939616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:09.939893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] PATH_INFO: `/v3/users/f42975cc45114323bf9af95ef10ff581` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:09.941172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42975cc45114323bf9af95ef10ff581)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:09.943201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:10.138179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42975cc45114323bf9af95ef10ff581'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.150790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42975cc45114323bf9af95ef10ff581'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.151491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42975cc45114323bf9af95ef10ff581'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.152125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42975cc45114323bf9af95ef10ff581'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.199371 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-40d40c06-23c1-4718-ad72-5246cc05568a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42975cc45114323bf9af95ef10ff581'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.214579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1193/2371] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:09 2022] DELETE /identity/v3/users/f42975cc45114323bf9af95ef10ff581 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:10.623669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:10.626293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:10.649613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4fb26-f9f5-47bd-858f-dcdd3f9def32 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:10.707486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:10.708308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:10.708594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:10.708893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] PATH_INFO: `/v3/projects/f2338f564cf8444b84eaaf683a13ce45` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:10.710070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2338f564cf8444b84eaaf683a13ce45)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:10.712101 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:10.810665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2338f564cf8444b84eaaf683a13ce45', 'request_id': 'req-a1034d13-faf0-443d-91f6-b0671e31b7e8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.871701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2338f564cf8444b84eaaf683a13ce45', 'request_id': 'req-a1034d13-faf0-443d-91f6-b0671e31b7e8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.878480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2338f564cf8444b84eaaf683a13ce45', 'request_id': 'req-a1034d13-faf0-443d-91f6-b0671e31b7e8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.890286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] The token cache is being invalidate because project f2338f564cf8444b84eaaf683a13ce45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:10.890568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.891238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a1034d13-faf0-443d-91f6-b0671e31b7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:10.892881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1179/2372] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:10 2022] DELETE /identity/v3/projects/f2338f564cf8444b84eaaf683a13ce45 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:10.897743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:10.898304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:10.898304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:10.915787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:10.916983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:10.976557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1194/2373] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:10.984785 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:10.985214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:10.985597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.004538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:11.005741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:11.013782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1180/2374] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:24:11.018529 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.028103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2975657-7743-4d7f-af68-ae1e4bba8876 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.033022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.033671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.033952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.034228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.034949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:24:11.035289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.036879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.049638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1195/2375] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:24:11.054076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.063502 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586578b-59b3-4109-9c21-a865cf520952 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.068306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.068957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.069245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.069519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.070206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.072190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.165562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1181/2376] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:11 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:11.166761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.177775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc2b92-592a-4e6c-b309-e1e8073d061e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.237339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.238292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.238292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.238552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.239195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.241110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.359469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1196/2377] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:11 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:24:11.363686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.374416 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902c2a-4694-44d7-9263-09400fffc54c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.379188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.379842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.380125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.380449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.381170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.382764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.394552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1182/2378] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:24:11.398802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.409295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81276-1791-41bb-9b81-2171dc457cc0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.413934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93d3ef-114e-48a6-8d51-3c8ec96e2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.414834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93d3ef-114e-48a6-8d51-3c8ec96e2900 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.420950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93d3ef-114e-48a6-8d51-3c8ec96e2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.420950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93d3ef-114e-48a6-8d51-3c8ec96e2900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.420950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93d3ef-114e-48a6-8d51-3c8ec96e2900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.420950 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93d3ef-114e-48a6-8d51-3c8ec96e2900 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.427652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1197/2379] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:11.431873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.442732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae5efc-feef-4094-8953-bc633894f9a1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.447534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.448414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.448700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.448975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] PATH_INFO: `/v3/projects/8b18d85123b549468709b436b70157e4/users/61178259084e4cf5832f9c20846e469f/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.464665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b18d85123b549468709b436b70157e4, user_id=61178259084e4cf5832f9c20846e469f, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.467347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.530871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1183/2380] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:11 2022] PUT /identity/v3/projects/8b18d85123b549468709b436b70157e4/users/61178259084e4cf5832f9c20846e469f/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:24:11.542848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.543171 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.543447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.570754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] MFA Rules not processed for user `61178259084e4cf5832f9c20846e469f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:11.572043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:11.637317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1198/2381] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:24:11.642810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.707318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80013695-ea38-4a5f-824b-78ee7a48786b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.712035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.712743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.713024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.713327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.714023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.715940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.815187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1184/2382] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:11 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:11.816299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.827256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac90e-cd7c-44d2-8768-d13950af3b1f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:11.883811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:11.884476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:11.884767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:11.885044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:11.885741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:11.887880 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:11.981035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1199/2383] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:11 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:24:11.989090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:11.996552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d65755-9148-421f-883d-4b5a78a80ea7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:12.002570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:12.003264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.003553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.003901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.004555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:12.006150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:12.017191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1185/2384] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:12.021302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:12.031214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df56e88-82e5-4023-9753-09edab866f0e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:12.035848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:12.036791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.037011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.037288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] PATH_INFO: `/v3/projects/6d8d41b1cd104d3287a00cbce3d14efb/users/50c243a85a454c54b3105007a9660b98/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.052702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8d41b1cd104d3287a00cbce3d14efb, user_id=50c243a85a454c54b3105007a9660b98, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:12.055404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:12.134297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1200/2385] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:12 2022] PUT /identity/v3/projects/6d8d41b1cd104d3287a00cbce3d14efb/users/50c243a85a454c54b3105007a9660b98/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:12.138254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:12.148072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca388-158c-4a47-8009-8d85035e4dfa admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:12.208155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85230-431d-42a1-9591-37bb63aa9e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:12.208318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85230-431d-42a1-9591-37bb63aa9e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.208543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85230-431d-42a1-9591-37bb63aa9e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.208821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85230-431d-42a1-9591-37bb63aa9e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.209552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85230-431d-42a1-9591-37bb63aa9e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:12.211168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85230-431d-42a1-9591-37bb63aa9e84 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:12.221837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1186/2386] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:24:12.226507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:12.237348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a6aab-a495-462a-bfb1-b2b997cc9ddd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:12.242021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:12.242896 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.243208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.243487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] PATH_INFO: `/v3/projects/6d8d41b1cd104d3287a00cbce3d14efb/users/50c243a85a454c54b3105007a9660b98/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.245509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8d41b1cd104d3287a00cbce3d14efb, user_id=50c243a85a454c54b3105007a9660b98, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:12.248306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:12.258395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1201/2387] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:12 2022] PUT /identity/v3/projects/6d8d41b1cd104d3287a00cbce3d14efb/users/50c243a85a454c54b3105007a9660b98/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:12.269360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.269696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.269954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.297856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] MFA Rules not processed for user `50c243a85a454c54b3105007a9660b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:12.298314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:12.365671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1187/2388] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:12.377706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:12.379431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:12.437701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee561b8-f5a1-4d63-a5ec-33661ea73769 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:12.441363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:12.442008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.442291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.442568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.451468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:12.452982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:12.462179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1202/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:12.695104 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:12.705114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a07ce-7512-487e-94c3-cac8876aca60 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:12.708661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5589d1d-df7d-4f74-b4ad-8ae8676bbf58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:12.709371 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589d1d-df7d-4f74-b4ad-8ae8676bbf58 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:12.709577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589d1d-df7d-4f74-b4ad-8ae8676bbf58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:12.709858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589d1d-df7d-4f74-b4ad-8ae8676bbf58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:12.766957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5589d1d-df7d-4f74-b4ad-8ae8676bbf58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:12.768515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5589d1d-df7d-4f74-b4ad-8ae8676bbf58 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:12.777623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1188/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:20.161981 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:20.224548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6491ac-0746-423f-a4a5-33a68ed167fc service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:20.229017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:20.229876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:20.230156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:20.230429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] PATH_INFO: `/v3/users/61178259084e4cf5832f9c20846e469f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:20.231624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61178259084e4cf5832f9c20846e469f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:20.233538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:20.395829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61178259084e4cf5832f9c20846e469f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:20.407908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61178259084e4cf5832f9c20846e469f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:20.408694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61178259084e4cf5832f9c20846e469f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:20.409467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61178259084e4cf5832f9c20846e469f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:20.456091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61178259084e4cf5832f9c20846e469f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:20.468274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1203/2391] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:20 2022] DELETE /identity/v3/users/61178259084e4cf5832f9c20846e469f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:20.472997 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:20.473490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:20.473590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:20.490840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:20.492140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:20.550889 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1189/2392] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:20.560531 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:20.562022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:20.619994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218da0-ceea-4b22-9704-1cf2407b9892 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:20.623677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:20.624370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:20.624656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:20.624936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:20.635438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:20.636888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:20.651911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1204/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:21.064262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:21.065716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:21.080078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5349-200f-483d-8762-48780c5280bb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:21.084824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:21.085703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:21.086016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:21.086291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] PATH_INFO: `/v3/projects/8b18d85123b549468709b436b70157e4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:21.087552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b18d85123b549468709b436b70157e4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:21.089527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:21.205286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b18d85123b549468709b436b70157e4', 'request_id': 'req-e675b246-afeb-4c8c-85f9-74f66aa3eb44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.301687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b18d85123b549468709b436b70157e4', 'request_id': 'req-e675b246-afeb-4c8c-85f9-74f66aa3eb44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.308641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b18d85123b549468709b436b70157e4', 'request_id': 'req-e675b246-afeb-4c8c-85f9-74f66aa3eb44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.320067 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] The token cache is being invalidate because project 8b18d85123b549468709b436b70157e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:21.320357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.321230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.322807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1190/2394] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:21 2022] DELETE /identity/v3/projects/8b18d85123b549468709b436b70157e4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:21.326968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:21.337406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2676-69e7-4707-9e8c-a901d09d0177 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:21.393549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:21.394412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:21.394693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:21.394968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] PATH_INFO: `/v3/users/50c243a85a454c54b3105007a9660b98` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:21.396168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c243a85a454c54b3105007a9660b98)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:21.398111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:21.588995 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c243a85a454c54b3105007a9660b98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.601546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c243a85a454c54b3105007a9660b98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.602256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c243a85a454c54b3105007a9660b98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.602857 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c243a85a454c54b3105007a9660b98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.665964 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1df5e1c1-def0-4e65-8c92-49411720944c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c243a85a454c54b3105007a9660b98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:21.678533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1205/2395] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:21 2022] DELETE /identity/v3/users/50c243a85a454c54b3105007a9660b98 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:22.079027 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.081072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:22.095148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b246-afeb-4c8c-85f9-74f66aa3eb44 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.158123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.159288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.159759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.160179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] PATH_INFO: `/v3/projects/6d8d41b1cd104d3287a00cbce3d14efb` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.161569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8d41b1cd104d3287a00cbce3d14efb)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.163687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:22.297569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8d41b1cd104d3287a00cbce3d14efb', 'request_id': 'req-c7ef947b-65a9-48fa-8876-c8c7fae10a11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:22.377398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8d41b1cd104d3287a00cbce3d14efb', 'request_id': 'req-c7ef947b-65a9-48fa-8876-c8c7fae10a11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:22.383648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8d41b1cd104d3287a00cbce3d14efb', 'request_id': 'req-c7ef947b-65a9-48fa-8876-c8c7fae10a11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:22.395646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] The token cache is being invalidate because project 6d8d41b1cd104d3287a00cbce3d14efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:22.395646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:22.396268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c7ef947b-65a9-48fa-8876-c8c7fae10a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:22.397891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1191/2396] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:22 2022] DELETE /identity/v3/projects/6d8d41b1cd104d3287a00cbce3d14efb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:22.402823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.403311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.403455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.421175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:22.422461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:22.485061 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1206/2397] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:22.494243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.494538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.494829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.515668 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:22.517191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:22.525900 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1192/2398] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:24:22.530394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.541281 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57757c9-31e8-40f3-853f-a502226aaefd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.546286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.546965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.547289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.547568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.548934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:24:22.549139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.550796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:22.564628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1207/2399] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:24:22.569187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.578767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea6a7-1cc3-4ba4-a4a1-24433729871b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.583970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.584679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.584966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.585248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.586113 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.588123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:22.675964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1193/2400] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:22 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:22.680203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.690524 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d4fb0-4724-4930-ad38-a71fc981ba0d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.746636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.747420 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.747704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.747982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.748675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.750673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:22.848684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1208/2401] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:22 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:22.850240 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.861210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2950f74-6cbc-4b5c-a1c3-5a01badb1e2f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.865891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.866546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.866832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.867146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.867901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.869485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:22.883270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1194/2402] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:22.884027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.893879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0127-fb6c-4f20-bd2a-b2eebadb4342 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.898462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5da02-2e47-4423-8fc8-4442b15278a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.899148 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5da02-2e47-4423-8fc8-4442b15278a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.899433 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5da02-2e47-4423-8fc8-4442b15278a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.899708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5da02-2e47-4423-8fc8-4442b15278a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.900424 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5da02-2e47-4423-8fc8-4442b15278a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.902018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5da02-2e47-4423-8fc8-4442b15278a4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:22.912372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1209/2403] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:22.921053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:22.932217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475020-051e-439f-b14f-a212dcf26672 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:22.936694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:22.937693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:22.938568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:22.938568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] PATH_INFO: `/v3/projects/285b74dcce604f1d9bac03c16186f5d6/users/51681985d8eb48dca5bbcf30f6103571/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:22.954575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=285b74dcce604f1d9bac03c16186f5d6, user_id=51681985d8eb48dca5bbcf30f6103571, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:22.957270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:23.053692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1195/2404] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:22 2022] PUT /identity/v3/projects/285b74dcce604f1d9bac03c16186f5d6/users/51681985d8eb48dca5bbcf30f6103571/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:23.066142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:23.066273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:23.066493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:23.100193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] MFA Rules not processed for user `51681985d8eb48dca5bbcf30f6103571`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:23.107762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:23.169968 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1210/2405] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:23.182409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:23.184507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:23.246939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3f41c-0b04-4a58-b30d-051308421fbc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:23.251832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52575d-c3f8-4e68-a914-7fe1430352dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:23.252580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52575d-c3f8-4e68-a914-7fe1430352dd service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:23.252917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52575d-c3f8-4e68-a914-7fe1430352dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:23.253222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52575d-c3f8-4e68-a914-7fe1430352dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:23.262388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52575d-c3f8-4e68-a914-7fe1430352dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:23.263891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52575d-c3f8-4e68-a914-7fe1430352dd service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:23.273966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1196/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:23.295023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:23.358536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ddfef-60ef-41c3-a15c-addbcbd52370 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:23.363263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:23.364134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:23.364459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:23.364726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] PATH_INFO: `/v3/users/51681985d8eb48dca5bbcf30f6103571` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:23.365927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51681985d8eb48dca5bbcf30f6103571)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:23.367899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:23.567384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51681985d8eb48dca5bbcf30f6103571'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:23.579538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51681985d8eb48dca5bbcf30f6103571'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:23.580326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51681985d8eb48dca5bbcf30f6103571'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:23.580998 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51681985d8eb48dca5bbcf30f6103571'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:23.679263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51681985d8eb48dca5bbcf30f6103571'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:23.692706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1211/2407] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:23 2022] DELETE /identity/v3/users/51681985d8eb48dca5bbcf30f6103571 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:23.697635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:23.697928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:23.698208 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:23.718765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:23.720098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:23.783937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1197/2408] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:24:23.794135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:23.795590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:23.854871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db61bf-deca-4ccb-bab2-1e8a90be5949 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:23.858869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8072be7-e71c-4530-8c52-f01e35b198bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:23.859552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8072be7-e71c-4530-8c52-f01e35b198bb service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:23.859842 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8072be7-e71c-4530-8c52-f01e35b198bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:23.860649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8072be7-e71c-4530-8c52-f01e35b198bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:23.870198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8072be7-e71c-4530-8c52-f01e35b198bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:23.871659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8072be7-e71c-4530-8c52-f01e35b198bb service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:23.881637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1212/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:24.298938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:24.300608 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:24.313063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51feecb8-b97d-467e-99af-1ead36b430f2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:24.333896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:24.334603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:24.335030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:24.335336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] PATH_INFO: `/v3/projects/285b74dcce604f1d9bac03c16186f5d6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:24.336530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285b74dcce604f1d9bac03c16186f5d6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:24.338455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:24.473583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285b74dcce604f1d9bac03c16186f5d6', 'request_id': 'req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:24.548277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285b74dcce604f1d9bac03c16186f5d6', 'request_id': 'req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:24.554073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285b74dcce604f1d9bac03c16186f5d6', 'request_id': 'req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:24.565370 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] The token cache is being invalidate because project 285b74dcce604f1d9bac03c16186f5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:24.567211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:24.567211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ce8f7ab-b29b-46f5-8838-cf31b663ae99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:24.568050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1198/2410] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:24 2022] DELETE /identity/v3/projects/285b74dcce604f1d9bac03c16186f5d6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:24.572946 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:24.573430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:24.573560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:24.591949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:24.593153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:24.663888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1213/2411] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:24.672210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:24.672828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:24.673254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:24.695353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:24.696860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:24.706257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1199/2412] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:24.711184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:24.721796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257aa99-9ba7-493b-a415-6a22d9f6f866 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:24.726910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:24.727613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:24.727902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:24.728181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:24.728917 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:24:24.729223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:24.730826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:24.745654 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1214/2413] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:24:24.749620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:24.760418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d237e4-0f7a-4d5b-8997-ee318ae6eae0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:24.765343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:24.766928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:24.767703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:24.768433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:24.769280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:24.771515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:24.868241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1200/2414] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:24:24 2022] POST /identity/v3/projects => generated 359 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:24.872598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:24.883448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b1932-8216-473c-8693-87465480ca3b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:24.945600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:24.946826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:24.947165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:24.947440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:24.948335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:24.950450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:25.072080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1215/2415] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:24:24 2022] POST /identity/v3/users => generated 280 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:24:25.076176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:25.087042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4984730-5f79-44d6-b8c4-2d62d70daf8f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:25.091673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:25.092331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.092619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.092965 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.093704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:25.096368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:25.107034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1201/2416] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:25.112985 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:25.123028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78e0c-c832-4ee7-9c59-9e49eb3bd0ac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:25.127730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc015109-a98b-4ac7-aa04-77eb0136fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:25.128384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc015109-a98b-4ac7-aa04-77eb0136fd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.128698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc015109-a98b-4ac7-aa04-77eb0136fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.128988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc015109-a98b-4ac7-aa04-77eb0136fd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.129705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc015109-a98b-4ac7-aa04-77eb0136fd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:25.131343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc015109-a98b-4ac7-aa04-77eb0136fd12 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:25.141335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1216/2417] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:24:25.145866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:25.155929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee96a2-cd6c-4a24-871a-0e5e2237ce9d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:25.161847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:25.162736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.163053 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.163334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] PATH_INFO: `/v3/projects/8f81f869577c432f90179bb4261e8d6a/users/a83d4efb40f447199fc585c61252cebf/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.179850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f81f869577c432f90179bb4261e8d6a, user_id=a83d4efb40f447199fc585c61252cebf, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:25.182546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:25.255232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1202/2418] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:24:25 2022] PUT /identity/v3/projects/8f81f869577c432f90179bb4261e8d6a/users/a83d4efb40f447199fc585c61252cebf/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:25.266803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.267223 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.267599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.295813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] MFA Rules not processed for user `a83d4efb40f447199fc585c61252cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:25.297012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:25.361263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1217/2419] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:25.399319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:25.401045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:25.463112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1f00-0a64-4dd2-b7fb-e5d4a0083d31 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:25.467141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bc828-7d33-4b2f-a805-8c1d50dfc53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:25.468080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc828-7d33-4b2f-a805-8c1d50dfc53a service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.468080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc828-7d33-4b2f-a805-8c1d50dfc53a service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.468404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc828-7d33-4b2f-a805-8c1d50dfc53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.478421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bc828-7d33-4b2f-a805-8c1d50dfc53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:25.479945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bc828-7d33-4b2f-a805-8c1d50dfc53a service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:25.490599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1203/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:25 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:25.506244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:25.576956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fd341-4641-4fdc-8c11-a4bfaa130f93 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:25.583742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:25.584656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.584939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.585215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] PATH_INFO: `/v3/users/a83d4efb40f447199fc585c61252cebf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.586455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83d4efb40f447199fc585c61252cebf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:25.588459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:25.716381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83d4efb40f447199fc585c61252cebf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:25.729244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83d4efb40f447199fc585c61252cebf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:25.729999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83d4efb40f447199fc585c61252cebf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:25.731405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83d4efb40f447199fc585c61252cebf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:25.808349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83d4efb40f447199fc585c61252cebf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:25.822739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1218/2421] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:25 2022] DELETE /identity/v3/users/a83d4efb40f447199fc585c61252cebf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:25.827368 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.827662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.827946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.845741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:25.847078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:25.906396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1204/2422] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:25.916749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:25.918131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:25.975962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077488a-bc2e-4aa4-b402-5008b16648be admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:25.979580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb6b3-8dcd-474a-b82b-db3566c8f7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:25.980218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb6b3-8dcd-474a-b82b-db3566c8f7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:25.980497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb6b3-8dcd-474a-b82b-db3566c8f7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:25.980770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb6b3-8dcd-474a-b82b-db3566c8f7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:25.991297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb6b3-8dcd-474a-b82b-db3566c8f7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:25.992766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb6b3-8dcd-474a-b82b-db3566c8f7c0 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:26.002621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1219/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:26.560584 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:26.562174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:26.576239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca2e9-5d14-4ca3-8712-a63b53a54768 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:26.581826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:26.582952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:26.583265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:26.583552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] PATH_INFO: `/v3/projects/8f81f869577c432f90179bb4261e8d6a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:26.584747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f81f869577c432f90179bb4261e8d6a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:26.586728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:26.692191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f81f869577c432f90179bb4261e8d6a', 'request_id': 'req-0975b792-edef-4a7b-be41-f9b45844cf12'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:26.776539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f81f869577c432f90179bb4261e8d6a', 'request_id': 'req-0975b792-edef-4a7b-be41-f9b45844cf12'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:26.783659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f81f869577c432f90179bb4261e8d6a', 'request_id': 'req-0975b792-edef-4a7b-be41-f9b45844cf12'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:26.795594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] The token cache is being invalidate because project 8f81f869577c432f90179bb4261e8d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:26.795880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:26.796522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:26.798585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1205/2424] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:26 2022] DELETE /identity/v3/projects/8f81f869577c432f90179bb4261e8d6a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:35.678496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86043e-7779-4f1f-925b-49d32cacef47 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:35.679129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86043e-7779-4f1f-925b-49d32cacef47 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:35.679271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86043e-7779-4f1f-925b-49d32cacef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:35.697034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0a86043e-7779-4f1f-925b-49d32cacef47 None None] MFA Rules not processed for user `480f3fa6c37b4d018ffa5803027d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:35.698257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0a86043e-7779-4f1f-925b-49d32cacef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:35.754927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1220/2425] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:24:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:24:38.935476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:38.937022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:39.007272 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b792-edef-4a7b-be41-f9b45844cf12 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:39.012183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:39.012836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:39.013122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:39.013404 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:39.015214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:39.027131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:39.028724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:39.039317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1206/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:24:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:24:42.231190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb961-f30b-4ab0-86c8-5ee01b0ac090 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:42.231633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb961-f30b-4ab0-86c8-5ee01b0ac090 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:42.231778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb961-f30b-4ab0-86c8-5ee01b0ac090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:42.250302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2e0fb961-f30b-4ab0-86c8-5ee01b0ac090 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:42.251572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2e0fb961-f30b-4ab0-86c8-5ee01b0ac090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:42.306375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1221/2427] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 18:24:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:24:42.517915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:42.520548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:42.599355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746caa9-8f25-4d5c-aeab-1eea5fc1be79 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:42.604450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:42.605095 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:42.605382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:42.605662 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:42.615490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:42.617014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:42.625630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1207/2428] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:24:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:24:47.062975 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:47.064548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:47.064971 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:47.106047 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:24:47.107405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:47.120745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1222/2429] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:24:47.142691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:47.155630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596162f-0507-48e5-aff0-30e9cfde1557 service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:47.162207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:47.162962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:47.163583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:47.163953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:47.178361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:47.181307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:47.195121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1208/2430] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:24:52.950500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:52.951786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:53.074478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071bbae-ce10-4c85-967f-7e013b0695e8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:53.085821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:53.087589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:53.087879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:53.093369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] PATH_INFO: `/v3/users/a4607ae490bb491ba40b13a86ec43f1a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:53.093369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4607ae490bb491ba40b13a86ec43f1a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:53.093369 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:53.279911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4607ae490bb491ba40b13a86ec43f1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:53.305357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4607ae490bb491ba40b13a86ec43f1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:53.306861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4607ae490bb491ba40b13a86ec43f1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:53.308513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4607ae490bb491ba40b13a86ec43f1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:53.399907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4607ae490bb491ba40b13a86ec43f1a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:53.426087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1223/2431] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:52 2022] DELETE /identity/v3/users/a4607ae490bb491ba40b13a86ec43f1a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:53.738298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:53.757853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb7380-a170-4010-a691-b9b58f7c9756 service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:53.847763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:53.849054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:53.849568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:53.850156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] PATH_INFO: `/v3/projects/b773343d1a8d4e6889bb80f938a389a4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:53.852366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b773343d1a8d4e6889bb80f938a389a4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:53.855238 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:53.994878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b773343d1a8d4e6889bb80f938a389a4', 'request_id': 'req-a4efb31f-54c2-415a-932e-e92898e68da8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.073734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b773343d1a8d4e6889bb80f938a389a4', 'request_id': 'req-a4efb31f-54c2-415a-932e-e92898e68da8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.083019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b773343d1a8d4e6889bb80f938a389a4', 'request_id': 'req-a4efb31f-54c2-415a-932e-e92898e68da8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.097096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] The token cache is being invalidate because project b773343d1a8d4e6889bb80f938a389a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:54.097537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.098527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.103411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1209/2432] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:53 2022] DELETE /identity/v3/projects/b773343d1a8d4e6889bb80f938a389a4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:54.105791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:54.108926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:54.123484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bbb9-bded-4939-80da-40a8c8342399 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:54.187776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:54.189664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:54.189774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:54.190123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] PATH_INFO: `/v3/users/b24c225125164eeab8c44e4c3b6b500e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:54.191310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24c225125164eeab8c44e4c3b6b500e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:54.193287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:54.676474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24c225125164eeab8c44e4c3b6b500e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.694900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24c225125164eeab8c44e4c3b6b500e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.699286 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24c225125164eeab8c44e4c3b6b500e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.699905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24c225125164eeab8c44e4c3b6b500e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.831430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-416131c4-5ff0-4206-ae26-d644aff78f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24c225125164eeab8c44e4c3b6b500e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:54.846335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1224/2433] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:24:54 2022] DELETE /identity/v3/users/b24c225125164eeab8c44e4c3b6b500e => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:24:55.207560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:24:55.209732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:24:55.261612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb31f-54c2-415a-932e-e92898e68da8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:24:55.398570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292d77b-2549-441f-b359-032047550146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:24:55.399750 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292d77b-2549-441f-b359-032047550146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:24:55.400185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292d77b-2549-441f-b359-032047550146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:24:55.400629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292d77b-2549-441f-b359-032047550146 admin admin] PATH_INFO: `/v3/projects/d360a244203f4e9589615e72fc2747de` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:24:55.402064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292d77b-2549-441f-b359-032047550146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d360a244203f4e9589615e72fc2747de)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:24:55.404512 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292d77b-2549-441f-b359-032047550146 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:24:55.527071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0292d77b-2549-441f-b359-032047550146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd360a244203f4e9589615e72fc2747de', 'request_id': 'req-0292d77b-2549-441f-b359-032047550146'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:55.605804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0292d77b-2549-441f-b359-032047550146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd360a244203f4e9589615e72fc2747de', 'request_id': 'req-0292d77b-2549-441f-b359-032047550146'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:55.617663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0292d77b-2549-441f-b359-032047550146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd360a244203f4e9589615e72fc2747de', 'request_id': 'req-0292d77b-2549-441f-b359-032047550146'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:55.642658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0292d77b-2549-441f-b359-032047550146 admin admin] The token cache is being invalidate because project d360a244203f4e9589615e72fc2747de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:24:55.643650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0292d77b-2549-441f-b359-032047550146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:55.644698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0292d77b-2549-441f-b359-032047550146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:24:55.647623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1210/2434] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:24:55 2022] DELETE /identity/v3/projects/d360a244203f4e9589615e72fc2747de => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:05.513927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ce89-2ad4-49ea-82a8-13f24d649013 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:05.514513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ce89-2ad4-49ea-82a8-13f24d649013 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:05.514513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ce89-2ad4-49ea-82a8-13f24d649013 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:05.515940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1225/2435] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:25:05.522273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b55d-b8e9-4f3c-be02-bfa26cb688d0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:05.522782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b55d-b8e9-4f3c-be02-bfa26cb688d0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:05.522907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b55d-b8e9-4f3c-be02-bfa26cb688d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:05.542812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cc95b55d-b8e9-4f3c-be02-bfa26cb688d0 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:05.544351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc95b55d-b8e9-4f3c-be02-bfa26cb688d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:05.611221 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1211/2436] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:05.622821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2ce89-2ad4-49ea-82a8-13f24d649013 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:05.624565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f8e2ce89-2ad4-49ea-82a8-13f24d649013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:05.682273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2ce89-2ad4-49ea-82a8-13f24d649013 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:05.685847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aaea3-b2e6-42ad-833e-567131c70db9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:05.686485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aaea3-b2e6-42ad-833e-567131c70db9 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:05.686770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aaea3-b2e6-42ad-833e-567131c70db9 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:05.687076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aaea3-b2e6-42ad-833e-567131c70db9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:05.697253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aaea3-b2e6-42ad-833e-567131c70db9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:05.698860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aaea3-b2e6-42ad-833e-567131c70db9 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:05.710132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1226/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:25:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:25:05.908741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feb8d3-939f-43e2-b1f1-bd6c8639b8ed None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:05.909116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feb8d3-939f-43e2-b1f1-bd6c8639b8ed None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:05.909399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feb8d3-939f-43e2-b1f1-bd6c8639b8ed None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:05.911063 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1212/2438] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:25:05.916804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bb4f-ce74-4e1f-b538-5d4323af508d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:05.917095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bb4f-ce74-4e1f-b538-5d4323af508d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:05.917376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bb4f-ce74-4e1f-b538-5d4323af508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:05.935700 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-49e5bb4f-ce74-4e1f-b538-5d4323af508d None None] MFA Rules not processed for user `635272c212ea47379b70362109b4804d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:05.936940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-49e5bb4f-ce74-4e1f-b538-5d4323af508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:05.989479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1227/2439] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:06.002060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feb8d3-939f-43e2-b1f1-bd6c8639b8ed None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:06.003868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-23feb8d3-939f-43e2-b1f1-bd6c8639b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:06.019336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feb8d3-939f-43e2-b1f1-bd6c8639b8ed None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:06.023554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813d4c8-551c-497e-99e1-159060b4d47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:06.024212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d4c8-551c-497e-99e1-159060b4d47f service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:06.024501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d4c8-551c-497e-99e1-159060b4d47f service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:06.024914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d4c8-551c-497e-99e1-159060b4d47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:06.039730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813d4c8-551c-497e-99e1-159060b4d47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:06.041184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813d4c8-551c-497e-99e1-159060b4d47f service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:06.050122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1213/2440] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:25:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:25:06.145736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433114d-b241-4f78-877b-ee4e305fbc8a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:06.146311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433114d-b241-4f78-877b-ee4e305fbc8a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:06.146620 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433114d-b241-4f78-877b-ee4e305fbc8a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:06.149289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1228/2441] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 18:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:25:06.155395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ef4dd-47ec-40cb-a1b3-b9de6f9e4b49 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:06.158036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ef4dd-47ec-40cb-a1b3-b9de6f9e4b49 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:06.158036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ef4dd-47ec-40cb-a1b3-b9de6f9e4b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:06.176090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6c2ef4dd-47ec-40cb-a1b3-b9de6f9e4b49 None None] MFA Rules not processed for user `a8eeb8fcc242428cb31dc31e25e7865f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:06.177298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6c2ef4dd-47ec-40cb-a1b3-b9de6f9e4b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:06.189174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1214/2442] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:06.200276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433114d-b241-4f78-877b-ee4e305fbc8a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:06.213533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433114d-b241-4f78-877b-ee4e305fbc8a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:06.218002 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:06.218683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:06.219348 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:06.219794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:06.231735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:06.233266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:06.245546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1229/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:25:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:25:08.828082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:08.829253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:08.829253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:08.846818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:08.848045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:08.901276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1215/2444] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:25:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:08.913833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:08.915475 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:08.981652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfe5b-e8e4-4649-8476-102e2f3c9e9f service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:08.986875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:08.987556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:08.987840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:08.988125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:08.996336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:08.997908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:09.006069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1230/2445] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:25:10.428319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:10.430460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:10.444177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21f2bd-d3c8-4ef1-a981-b860fa29030b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:10.448283 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:10.449136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:10.449488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:10.449858 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:10.451786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:10.525444 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:10.526961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0103404-898e-41b2-9a59-27075da40ee8 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:10.541908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1216/2446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:25:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:25:29.290677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:29.300120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452e13b-e836-46de-b41f-230fe2bef250 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:29.303747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:29.306125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:29.306125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:29.306125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:29.306774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:29.368898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:29.370341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:29.380712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1231/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:25:30.417244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:30.417982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:30.417982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:30.436886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:30.438510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:30.448394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1217/2448] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 18:25:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:30.464668 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:30.478462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779955-2019-45c9-acdd-d3f2de794292 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:30.483825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:30.484484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:30.484771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:30.485046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:30.494328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:30.496001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:30.504559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1232/2449] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:25:37.155270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:37.156701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:37.172595 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401cac1-cdbb-47a8-8a4f-edfe80e8cd70 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:37.177913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:37.178783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:37.179099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:37.179384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] PATH_INFO: `/v3/users/af5972d049c243b48d0a59a7d4028273` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:37.180590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5972d049c243b48d0a59a7d4028273)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:37.182501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:37.332945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5972d049c243b48d0a59a7d4028273'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.333678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5972d049c243b48d0a59a7d4028273'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.345507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5972d049c243b48d0a59a7d4028273'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.347183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5972d049c243b48d0a59a7d4028273'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.407995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5972d049c243b48d0a59a7d4028273'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.421389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1218/2450] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:25:37 2022] DELETE /identity/v3/users/af5972d049c243b48d0a59a7d4028273 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:37.662035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:37.673474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52782509-aaec-4e37-8863-ed1c8d87e5bc service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:37.738399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:37.739307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:37.739600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:37.740702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] PATH_INFO: `/v3/projects/5b095a86e9004719a23c3a0bd0f8a986` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:37.741999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b095a86e9004719a23c3a0bd0f8a986)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:37.744010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:37.903790 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b095a86e9004719a23c3a0bd0f8a986', 'request_id': 'req-be1bd1f7-2bc3-4c3e-8d37-410746485969'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.970415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b095a86e9004719a23c3a0bd0f8a986', 'request_id': 'req-be1bd1f7-2bc3-4c3e-8d37-410746485969'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.977395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b095a86e9004719a23c3a0bd0f8a986', 'request_id': 'req-be1bd1f7-2bc3-4c3e-8d37-410746485969'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.990103 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] The token cache is being invalidate because project 5b095a86e9004719a23c3a0bd0f8a986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:25:37.990394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.991085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:37.992945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1233/2451] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:25:37 2022] DELETE /identity/v3/projects/5b095a86e9004719a23c3a0bd0f8a986 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:37.996787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:37.998334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:38.012456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045152-1a2b-4026-994e-feecb8cc9ae1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:38.068145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:38.069012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:38.069293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:38.069565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] PATH_INFO: `/v3/users/5bc51f418c9244e39021aabc60179dd2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:38.070779 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc51f418c9244e39021aabc60179dd2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:38.072769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:38.235428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc51f418c9244e39021aabc60179dd2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.236079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc51f418c9244e39021aabc60179dd2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.248495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc51f418c9244e39021aabc60179dd2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.249186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc51f418c9244e39021aabc60179dd2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.313442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc51f418c9244e39021aabc60179dd2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.327052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1219/2452] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:25:37 2022] DELETE /identity/v3/users/5bc51f418c9244e39021aabc60179dd2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:38.601499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:38.603117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:38.617822 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd1f7-2bc3-4c3e-8d37-410746485969 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:38.679679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:38.680533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:38.680814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:38.681088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] PATH_INFO: `/v3/projects/f31b7ff7d7544a43be9bc12dea90c978` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:38.682251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31b7ff7d7544a43be9bc12dea90c978)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:38.684174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:38.781117 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31b7ff7d7544a43be9bc12dea90c978', 'request_id': 'req-eb0df623-9b03-4cf6-a0e3-c282fa299599'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.854119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31b7ff7d7544a43be9bc12dea90c978', 'request_id': 'req-eb0df623-9b03-4cf6-a0e3-c282fa299599'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.860069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31b7ff7d7544a43be9bc12dea90c978', 'request_id': 'req-eb0df623-9b03-4cf6-a0e3-c282fa299599'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.871325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] The token cache is being invalidate because project f31b7ff7d7544a43be9bc12dea90c978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:25:38.871617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.872258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:38.873803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1234/2453] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:25:38 2022] DELETE /identity/v3/projects/f31b7ff7d7544a43be9bc12dea90c978 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:54.109532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:54.111015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:54.168254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf520-7921-4e79-b021-b646e260b4e0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:54.215519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:54.216167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:54.216446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:54.216720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:54.218582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:54.285080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:54.286591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:54.297316 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1220/2454] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:25:58.074750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:58.076751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:58.091770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df623-9b03-4cf6-a0e3-c282fa299599 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:58.096543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:58.097402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:58.097686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:58.097961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] PATH_INFO: `/v3/users/994dc4b8b3e047ddbe501ff74f3c709d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:58.112849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=994dc4b8b3e047ddbe501ff74f3c709d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:58.114761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:58.303959 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994dc4b8b3e047ddbe501ff74f3c709d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.315509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994dc4b8b3e047ddbe501ff74f3c709d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.316267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994dc4b8b3e047ddbe501ff74f3c709d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.316939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994dc4b8b3e047ddbe501ff74f3c709d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.382116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a5f3308-0274-47a0-8a78-3f6c4552c85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994dc4b8b3e047ddbe501ff74f3c709d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.395068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1235/2455] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:25:58 2022] DELETE /identity/v3/users/994dc4b8b3e047ddbe501ff74f3c709d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:58.666763 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:58.678798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e156-5dad-46e6-bbe9-04e1a2992778 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:58.742305 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:58.743201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:58.743511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:58.743789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] PATH_INFO: `/v3/projects/0998832c5db04fe5b7e93fa392a693f8` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:58.754249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0998832c5db04fe5b7e93fa392a693f8)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:58.757188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:58.859579 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0998832c5db04fe5b7e93fa392a693f8', 'request_id': 'req-4f839511-630e-4dc7-a0ec-c39a0c464dbf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.936409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0998832c5db04fe5b7e93fa392a693f8', 'request_id': 'req-4f839511-630e-4dc7-a0ec-c39a0c464dbf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.942450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0998832c5db04fe5b7e93fa392a693f8', 'request_id': 'req-4f839511-630e-4dc7-a0ec-c39a0c464dbf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.956270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] The token cache is being invalidate because project 0998832c5db04fe5b7e93fa392a693f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:25:58.956559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.957215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4f839511-630e-4dc7-a0ec-c39a0c464dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:25:58.959555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1221/2456] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:25:58 2022] DELETE /identity/v3/projects/0998832c5db04fe5b7e93fa392a693f8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:25:58.964532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:58.964853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:58.965136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:58.983015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:58.984206 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:59.056360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1236/2457] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:59.064500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.064793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.065075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.084388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:59.085702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:59.093909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1222/2458] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:59.098265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.108550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c70f8f-f5b3-4719-93d4-e04e74234562 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.113423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.114076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.114380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.114750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.116372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:25:59.116778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.118384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.129939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1237/2459] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:25:59.135036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.144294 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb22c-3180-484d-a734-d3ea240d5eef None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.148950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.149596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.149883 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.150165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.150880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.152850 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.261934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1223/2460] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:25:59 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:25:59.266042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.276324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e84d2-a1f4-4336-aa74-3cf1db482345 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.332900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.333573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.333934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.334454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.335233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.337367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.407837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1238/2461] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:25:59 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:25:59.412623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.423280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90e85-08a7-4f37-81ee-226e3ab9f612 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.428469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.430425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.430425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.430425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.430425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.432020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.441758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1224/2462] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:25:59.445976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.455940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462ad4-967c-4e06-8fc7-0ea870cb97dc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.461055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a0cb0-4677-4b0d-859b-8a25a66ab66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.461658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a0cb0-4677-4b0d-859b-8a25a66ab66b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.462062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a0cb0-4677-4b0d-859b-8a25a66ab66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.462343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a0cb0-4677-4b0d-859b-8a25a66ab66b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.463111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a0cb0-4677-4b0d-859b-8a25a66ab66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.464749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a0cb0-4677-4b0d-859b-8a25a66ab66b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.475722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1239/2463] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:25:59.480106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.489934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfdead-cf6f-4382-8f58-297dff69166d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.495059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.495928 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.496218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.496497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] PATH_INFO: `/v3/projects/f86cd59f576849fe842c5ced473b00e8/users/968651c9aa0140fe99933626c280a927/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.510759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86cd59f576849fe842c5ced473b00e8, user_id=968651c9aa0140fe99933626c280a927, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.513451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.617088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1225/2464] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:25:59 2022] PUT /identity/v3/projects/f86cd59f576849fe842c5ced473b00e8/users/968651c9aa0140fe99933626c280a927/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:25:59.627934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.628222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.628498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.656182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] MFA Rules not processed for user `968651c9aa0140fe99933626c280a927`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:25:59.657431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:25:59.718392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1240/2465] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:25:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:25:59.722745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.782679 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4154-c354-4e72-b9a1-bdb2698842d2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.787982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.788635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.789185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.789461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.790144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.792083 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:25:59.891664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1226/2466] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:25:59 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:25:59.895577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:25:59.906681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cbbd9-f272-46d0-9cd1-f5163245341c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:25:59.965457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:25:59.966136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:25:59.966423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:25:59.966708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:25:59.967426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:25:59.969451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:00.056427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1241/2467] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:25:59 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:00.060742 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:00.071792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418c855-172a-4ad1-98f7-6f9eb0b61288 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:00.076304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:00.076955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:00.077236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:00.077511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:00.078234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:00.079856 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:00.091593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1227/2468] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:00.095756 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:00.105803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db3ae6-fb29-4953-81ba-13a8c834b424 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:00.110557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:00.111470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:00.111754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:00.112035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] PATH_INFO: `/v3/projects/aa1900382b4d447fa12a639b060c564f/users/8711e86dbd6d46c796611857fe94cb11/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:00.126944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1900382b4d447fa12a639b060c564f, user_id=8711e86dbd6d46c796611857fe94cb11, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:00.129690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:00.242670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1242/2469] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:00 2022] PUT /identity/v3/projects/aa1900382b4d447fa12a639b060c564f/users/8711e86dbd6d46c796611857fe94cb11/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:00.244051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:00.254875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77eb71-4621-42dd-abef-344f4f407851 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:00.313527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183f326-c17e-46d4-ba28-67bbe148c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:00.314203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183f326-c17e-46d4-ba28-67bbe148c5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:00.314490 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183f326-c17e-46d4-ba28-67bbe148c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:00.314772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183f326-c17e-46d4-ba28-67bbe148c5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:00.315540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183f326-c17e-46d4-ba28-67bbe148c5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:00.317175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183f326-c17e-46d4-ba28-67bbe148c5f9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:00.328175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1228/2470] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:00.332713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:00.345630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7347234-2aea-4ac5-9568-934f03b4700c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:00.347677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:00.348584 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:00.348869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:00.349146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] PATH_INFO: `/v3/projects/aa1900382b4d447fa12a639b060c564f/users/8711e86dbd6d46c796611857fe94cb11/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:00.351341 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1900382b4d447fa12a639b060c564f, user_id=8711e86dbd6d46c796611857fe94cb11, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:00.354071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:00.364516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1243/2471] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:00 2022] PUT /identity/v3/projects/aa1900382b4d447fa12a639b060c564f/users/8711e86dbd6d46c796611857fe94cb11/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:00.375396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:00.375689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:00.375973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:00.403055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] MFA Rules not processed for user `8711e86dbd6d46c796611857fe94cb11`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:00.404253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:00.473182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1229/2472] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:00.484742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:00.486406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:00.541381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801330f-3839-496e-87a0-cbfbe55254df admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:00.545125 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659800fd-616e-4569-82e9-73b04d5ad8eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:00.545761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659800fd-616e-4569-82e9-73b04d5ad8eb service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:00.546062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659800fd-616e-4569-82e9-73b04d5ad8eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:00.546336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659800fd-616e-4569-82e9-73b04d5ad8eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:00.556055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659800fd-616e-4569-82e9-73b04d5ad8eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:00.557522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659800fd-616e-4569-82e9-73b04d5ad8eb service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:00.566912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1244/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:01.523437 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:01.585657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bba5-4562-42ea-80bd-8af06e303a44 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:01.590383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:01.591322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:01.591602 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:01.591874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] PATH_INFO: `/v3/users/968651c9aa0140fe99933626c280a927` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:01.593111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968651c9aa0140fe99933626c280a927)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:01.595147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:01.755626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968651c9aa0140fe99933626c280a927'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:01.756596 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968651c9aa0140fe99933626c280a927'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:01.768968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968651c9aa0140fe99933626c280a927'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:01.769617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968651c9aa0140fe99933626c280a927'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:01.847927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968651c9aa0140fe99933626c280a927'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:01.861282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1230/2474] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:01 2022] DELETE /identity/v3/users/968651c9aa0140fe99933626c280a927 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:01.866666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:01.867218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:01.867327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:01.885287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:01.886491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:01.946594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1245/2475] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:01.957649 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:01.959588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:02.019809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2056547-3f98-4af4-beb7-5f84ae027c23 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:02.024411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:02.025776 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:02.026060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:02.026336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:02.036362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:02.040103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:02.048723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1231/2476] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:02.609710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:02.611914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:02.630480 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf830a8-84da-4e8f-85a3-326a2c7d8d48 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:02.644166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:02.644166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:02.644166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:02.644166 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] PATH_INFO: `/v3/projects/f86cd59f576849fe842c5ced473b00e8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:02.645510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86cd59f576849fe842c5ced473b00e8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:02.645510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:02.766042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86cd59f576849fe842c5ced473b00e8', 'request_id': 'req-55cf8821-3e31-4520-aaff-3b22585334ab'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:02.827461 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86cd59f576849fe842c5ced473b00e8', 'request_id': 'req-55cf8821-3e31-4520-aaff-3b22585334ab'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:02.835825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86cd59f576849fe842c5ced473b00e8', 'request_id': 'req-55cf8821-3e31-4520-aaff-3b22585334ab'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:02.847421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] The token cache is being invalidate because project f86cd59f576849fe842c5ced473b00e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:02.847713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:02.848357 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:02.850046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1246/2477] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:02 2022] DELETE /identity/v3/projects/f86cd59f576849fe842c5ced473b00e8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:02.854179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:02.863709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b83ed6-af84-4156-9456-78dcfcc08970 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:02.924686 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:02.925572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:02.925859 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:02.926141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] PATH_INFO: `/v3/users/8711e86dbd6d46c796611857fe94cb11` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:02.928057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8711e86dbd6d46c796611857fe94cb11)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:02.929986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:03.072098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8711e86dbd6d46c796611857fe94cb11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.072800 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8711e86dbd6d46c796611857fe94cb11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.086481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8711e86dbd6d46c796611857fe94cb11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.087282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8711e86dbd6d46c796611857fe94cb11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.156556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3102fe0f-ebff-4bef-b3d7-623d1454a901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8711e86dbd6d46c796611857fe94cb11'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.171696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1232/2478] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:02 2022] DELETE /identity/v3/users/8711e86dbd6d46c796611857fe94cb11 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:03.602302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:03.603863 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:03.619741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8821-3e31-4520-aaff-3b22585334ab admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:03.678333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:03.679287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:03.679509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:03.679787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] PATH_INFO: `/v3/projects/aa1900382b4d447fa12a639b060c564f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:03.680960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1900382b4d447fa12a639b060c564f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:03.682871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:03.810464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1900382b4d447fa12a639b060c564f', 'request_id': 'req-a78929c9-9296-46b9-8101-807cf6052aa8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.890512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1900382b4d447fa12a639b060c564f', 'request_id': 'req-a78929c9-9296-46b9-8101-807cf6052aa8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.897253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1900382b4d447fa12a639b060c564f', 'request_id': 'req-a78929c9-9296-46b9-8101-807cf6052aa8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.908939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] The token cache is being invalidate because project aa1900382b4d447fa12a639b060c564f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:03.911762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.911762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a78929c9-9296-46b9-8101-807cf6052aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:03.911762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1247/2479] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:03 2022] DELETE /identity/v3/projects/aa1900382b4d447fa12a639b060c564f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:03.917118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:03.917653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:03.917653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:03.935760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:03.936876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:03.995219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1233/2480] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:04.003014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.003314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.003595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.023006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:04.024216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:04.032102 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1248/2481] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:04.036509 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.046378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75d43f-0f86-4b9a-b800-53ebfcd0a9cc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.050802 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.051488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.051770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.052044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.053255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:26:04.053553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.055173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.066400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1234/2482] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:26:04.071726 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.081491 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6e2e-5859-45ba-aefe-3c8d06f70b5c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.086486 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.087186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.087483 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.087747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.088437 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.090346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.191890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1249/2483] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:04 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:04.196849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.207158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79438-6d84-4b56-8bca-4920970e759f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.262563 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.263257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.263543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.263821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.264697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.266653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.330398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1235/2484] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:04 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:04.335085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.345368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9fdcc-ce45-4308-8d44-93eab7b2f939 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.350144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.350797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.351123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.351405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.352127 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.353725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.364003 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1250/2485] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:04.368938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.379187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0e62-630f-4f48-93a6-69ca40ad57f6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.384503 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d9614-3b07-4d48-aef1-780f09af7eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.385159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d9614-3b07-4d48-aef1-780f09af7eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.385446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d9614-3b07-4d48-aef1-780f09af7eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.385730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d9614-3b07-4d48-aef1-780f09af7eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.386481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d9614-3b07-4d48-aef1-780f09af7eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.388106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d9614-3b07-4d48-aef1-780f09af7eb4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.398793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1236/2486] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:04.402962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.413634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043d869-faa5-41b3-a70d-21cf2742ccdb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.418605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.419512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.419799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.420078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] PATH_INFO: `/v3/projects/16c7614ecf6740f1a5c2241eb44be22a/users/685ff60c3f6c471b8d6275a0f9208e4a/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.435253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c7614ecf6740f1a5c2241eb44be22a, user_id=685ff60c3f6c471b8d6275a0f9208e4a, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.437920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.501949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1251/2487] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:04 2022] PUT /identity/v3/projects/16c7614ecf6740f1a5c2241eb44be22a/users/685ff60c3f6c471b8d6275a0f9208e4a/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:04.513747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.514097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.514381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.540565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] MFA Rules not processed for user `685ff60c3f6c471b8d6275a0f9208e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:04.541771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:04.603899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1237/2488] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:04.608404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.674633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554fb19-66dc-4d72-818b-6e46a0ff60d0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.680060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.680719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.681005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.681283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.681978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.683937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.800493 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1252/2489] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:04 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:04.805260 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.815731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ddc99-b69d-46f9-8d34-f0ed50fa4434 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.871220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.871871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.872151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.872423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.873096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.875017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.964789 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1238/2490] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:04 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:04.968847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:04.979460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95611bc-3fdf-458d-9ea8-e4c63f279d48 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:04.984376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:04.985060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:04.985345 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:04.985624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:04.986386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:04.988058 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:04.999684 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1253/2491] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:05.003804 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:05.014922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283922d-77c6-4487-b259-0344074087f4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:05.020084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:05.021004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:05.021284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:05.021558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] PATH_INFO: `/v3/projects/dad45dd795324e06963ca60c492e0f27/users/7665b32295dc49a3abd4d91d8086fa5a/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:05.036743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad45dd795324e06963ca60c492e0f27, user_id=7665b32295dc49a3abd4d91d8086fa5a, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:05.039805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:05.113787 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1239/2492] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:05 2022] PUT /identity/v3/projects/dad45dd795324e06963ca60c492e0f27/users/7665b32295dc49a3abd4d91d8086fa5a/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:05.118621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:05.128685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c51f31-cb64-4f04-af98-b3f7b5402877 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:05.183884 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13592bf2-fd6d-4059-b119-a8f85b9819be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:05.184550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13592bf2-fd6d-4059-b119-a8f85b9819be admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:05.184835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13592bf2-fd6d-4059-b119-a8f85b9819be admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:05.185111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13592bf2-fd6d-4059-b119-a8f85b9819be admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:05.185825 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13592bf2-fd6d-4059-b119-a8f85b9819be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:05.187454 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13592bf2-fd6d-4059-b119-a8f85b9819be admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:05.197154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1254/2493] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:05.201478 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:05.212619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1252802-781d-42ce-b17c-efb450f96494 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:05.217279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:05.218163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:05.218447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:05.218724 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] PATH_INFO: `/v3/projects/dad45dd795324e06963ca60c492e0f27/users/7665b32295dc49a3abd4d91d8086fa5a/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:05.220740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad45dd795324e06963ca60c492e0f27, user_id=7665b32295dc49a3abd4d91d8086fa5a, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:05.223419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:05.234312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1240/2494] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:05 2022] PUT /identity/v3/projects/dad45dd795324e06963ca60c492e0f27/users/7665b32295dc49a3abd4d91d8086fa5a/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:05.245516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:05.245814 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:05.246124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:05.272568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] MFA Rules not processed for user `7665b32295dc49a3abd4d91d8086fa5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:05.273776 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:05.341434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1255/2495] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:05.353002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:05.354636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:05.410450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5326f-2471-485c-92de-791bf6b31340 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:05.414914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:05.415646 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:05.415932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:05.416209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:05.471156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:05.472589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:05.482326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1241/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:26:12.807881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:12.817843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e6af-b376-4783-98f0-55fc2b629c28 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:12.822075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:12.822723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:12.823057 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:12.823350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:12.832632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:12.834071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:12.844594 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1256/2497] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:13.330857 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:13.332304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:13.343529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca09d-55c3-497a-aa19-daefb6c1156c service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:13.347089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:13.347726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:13.348009 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:13.348297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:13.350008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:13.422394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:13.423889 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:13.434966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1242/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:41.456456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:41.458291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:41.475472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feaf9c-4e2e-46a4-9c17-54daa35d9a4b service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:41.484386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:41.485048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:41.485330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:41.485610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:41.487473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:41.500747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:41.502443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d28a5-6d32-4a85-b6d7-d6f827ded577 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:41.514743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1257/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:45.151890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:45.217060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109bf76-bbe0-4293-9308-61984a4b4ce4 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:45.221691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:45.222561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:45.222881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:45.223188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] PATH_INFO: `/v3/users/685ff60c3f6c471b8d6275a0f9208e4a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:45.224382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=685ff60c3f6c471b8d6275a0f9208e4a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:45.226301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:45.420982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685ff60c3f6c471b8d6275a0f9208e4a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:45.421587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685ff60c3f6c471b8d6275a0f9208e4a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:45.432972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685ff60c3f6c471b8d6275a0f9208e4a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:45.434138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685ff60c3f6c471b8d6275a0f9208e4a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:45.506666 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685ff60c3f6c471b8d6275a0f9208e4a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:45.519832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1243/2500] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:45 2022] DELETE /identity/v3/users/685ff60c3f6c471b8d6275a0f9208e4a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:45.524277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:45.528661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:45.528661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:45.542897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:45.544748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:45.610963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1258/2501] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:45.619325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:45.620797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:45.681619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1256b5-5090-4a32-b845-f2e9d1c75768 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:45.686684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:45.687394 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:45.687685 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:45.687960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:45.698121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:45.699663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:45.709945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1244/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:46.106274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:46.108494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:46.122651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76ed6b-7530-4f77-9d1c-224c7b110899 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:46.127713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:46.132714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:46.132714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:46.132714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] PATH_INFO: `/v3/projects/16c7614ecf6740f1a5c2241eb44be22a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:46.132714 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c7614ecf6740f1a5c2241eb44be22a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:46.133504 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:46.282686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c7614ecf6740f1a5c2241eb44be22a', 'request_id': 'req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.344414 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c7614ecf6740f1a5c2241eb44be22a', 'request_id': 'req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.350413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c7614ecf6740f1a5c2241eb44be22a', 'request_id': 'req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.361597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] The token cache is being invalidate because project 16c7614ecf6740f1a5c2241eb44be22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:46.361883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.362587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.364169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1259/2503] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:46 2022] DELETE /identity/v3/projects/16c7614ecf6740f1a5c2241eb44be22a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:46.368181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:46.377691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd75241-f2d1-4ba2-85db-a98837cf7e3a service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:46.433939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:46.434828 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:46.435146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:46.435434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] PATH_INFO: `/v3/users/7665b32295dc49a3abd4d91d8086fa5a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:46.436626 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7665b32295dc49a3abd4d91d8086fa5a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:46.438530 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:46.669165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7665b32295dc49a3abd4d91d8086fa5a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.669521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7665b32295dc49a3abd4d91d8086fa5a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.681389 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7665b32295dc49a3abd4d91d8086fa5a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.682050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7665b32295dc49a3abd4d91d8086fa5a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.743989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5846d4cf-a5d8-42ac-ae8a-5aed7af5e21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7665b32295dc49a3abd4d91d8086fa5a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:46.756748 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1245/2504] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:46 2022] DELETE /identity/v3/users/7665b32295dc49a3abd4d91d8086fa5a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:47.172918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:47.174366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:47.206836 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e56f44-99ba-4d14-b7dc-9d53e9e11b2c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:47.264866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:47.265742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.266030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.266310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] PATH_INFO: `/v3/projects/dad45dd795324e06963ca60c492e0f27` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.267526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad45dd795324e06963ca60c492e0f27)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:47.269465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:47.395954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad45dd795324e06963ca60c492e0f27', 'request_id': 'req-b945ee53-3d05-4a69-8969-9a7dbfc14f85'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:47.481623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad45dd795324e06963ca60c492e0f27', 'request_id': 'req-b945ee53-3d05-4a69-8969-9a7dbfc14f85'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:47.488121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad45dd795324e06963ca60c492e0f27', 'request_id': 'req-b945ee53-3d05-4a69-8969-9a7dbfc14f85'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:47.499966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] The token cache is being invalidate because project dad45dd795324e06963ca60c492e0f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:47.500256 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:47.500903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b945ee53-3d05-4a69-8969-9a7dbfc14f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:47.502455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1260/2505] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:47 2022] DELETE /identity/v3/projects/dad45dd795324e06963ca60c492e0f27 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:47.507479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.508018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.508018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.526644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:47.527895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:47.588096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1246/2506] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:47.597596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.597882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.598162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.616576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:47.617762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:47.626697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1261/2507] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:47.631397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:47.642833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e188c-a19c-41f7-b0e7-f9bb1040cab8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:47.647860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:47.648892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.649179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.649459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.650192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:26:47.650505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:47.652231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:47.665003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1247/2508] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:26:47.670469 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:47.680026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795b0c5-5d42-4e18-9c33-f212f75033a9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:47.684661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:47.685918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.686185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.686463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.687195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:47.689191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:47.808821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1262/2509] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:47 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:47.813832 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:47.824289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25547-25f8-4e29-addf-427af7bd4f28 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:47.884244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:47.884917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.885200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.885475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.886159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:47.888105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:47.974167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1248/2510] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:47 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:47.978380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:47.989556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b648-967a-4752-9449-ef1f57029778 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:47.994273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:47.994924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:47.995259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:47.995543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:47.996313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:47.997920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.009035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1263/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:48.013297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.024468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdaf11-90bf-4496-9c67-cd2b95ee77a0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.029154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1439-946d-4990-bf5d-8a07d2aaa004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.030805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1439-946d-4990-bf5d-8a07d2aaa004 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.031165 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1439-946d-4990-bf5d-8a07d2aaa004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.031452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1439-946d-4990-bf5d-8a07d2aaa004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.032203 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1439-946d-4990-bf5d-8a07d2aaa004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.033795 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1439-946d-4990-bf5d-8a07d2aaa004 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.043984 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1249/2512] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:48.049095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.059421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28676b2-ee9d-474e-82f6-a6c142ae4688 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.064337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.065204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.065573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.065853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] PATH_INFO: `/v3/projects/23677e4899e54d7cbb28d3ca6d4df245/users/ea2bdb67fd764b0285f0066383b11a7c/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.080065 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23677e4899e54d7cbb28d3ca6d4df245, user_id=ea2bdb67fd764b0285f0066383b11a7c, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.082721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.149689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1264/2513] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:48 2022] PUT /identity/v3/projects/23677e4899e54d7cbb28d3ca6d4df245/users/ea2bdb67fd764b0285f0066383b11a7c/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:48.160819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.161116 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.161399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.189520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] MFA Rules not processed for user `ea2bdb67fd764b0285f0066383b11a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:48.190739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:48.258770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1250/2514] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:48.264554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.304597 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.306018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:48.328275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d18a-5e4e-40e1-a633-0676aedf3799 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.341451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.342672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.343071 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.343516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.344332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.346273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.365121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fa82-5059-4d53-98b0-9fc03f11feed None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.369236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.369893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.370201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.370506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.372479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:48.384873 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.386361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.396105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1251/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:26:48.454957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1265/2516] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:48 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:48.459292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.469653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1708e78-d238-4292-bd66-b0e32e07afda service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.527526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.528253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.528470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.528759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.530217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.532537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.648001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1252/2517] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:48 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:48.649678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.660306 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eecdf-280e-4874-bd94-192d483bfc6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.665169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.665828 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.666110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.666389 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.667165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.668757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.683354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1266/2518] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:48.684623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.695245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d631bc-9480-4d4e-b3b0-1d935efd5504 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.699950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.700839 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.701121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.701680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] PATH_INFO: `/v3/projects/284254d94fad49169f114a367af98786/users/f65eba907f8441a1ab043630207ea506/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.716960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284254d94fad49169f114a367af98786, user_id=f65eba907f8441a1ab043630207ea506, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.719656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.804118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1253/2519] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:48 2022] PUT /identity/v3/projects/284254d94fad49169f114a367af98786/users/f65eba907f8441a1ab043630207ea506/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:48.808121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.818911 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f3b47-2467-46a6-b18b-078a3db5f80d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.877079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f4e4c-748a-45b3-8a29-6e603bd13cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.877748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f4e4c-748a-45b3-8a29-6e603bd13cef admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.878032 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f4e4c-748a-45b3-8a29-6e603bd13cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.878310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f4e4c-748a-45b3-8a29-6e603bd13cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.879087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f4e4c-748a-45b3-8a29-6e603bd13cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.880739 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f4e4c-748a-45b3-8a29-6e603bd13cef admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.890901 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1267/2520] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:48.895303 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:48.906658 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fceb2-6c63-442a-98c8-f3707e4c5395 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:48.911718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:48.912703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.913312 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.913663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] PATH_INFO: `/v3/projects/284254d94fad49169f114a367af98786/users/f65eba907f8441a1ab043630207ea506/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.915733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284254d94fad49169f114a367af98786, user_id=f65eba907f8441a1ab043630207ea506, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:48.918459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:48.930845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1254/2521] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:48 2022] PUT /identity/v3/projects/284254d94fad49169f114a367af98786/users/f65eba907f8441a1ab043630207ea506/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:48.941809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:48.942174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:48.942545 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:48.968973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] MFA Rules not processed for user `f65eba907f8441a1ab043630207ea506`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:48.970179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:49.040323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1268/2522] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:49.052471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:49.054250 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:49.113039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c00839-14b8-42d5-9722-471d8c134536 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:49.116695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d2460-d482-4371-99ed-9cf6edae7359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:49.117346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d2460-d482-4371-99ed-9cf6edae7359 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:49.117632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d2460-d482-4371-99ed-9cf6edae7359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:49.117911 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d2460-d482-4371-99ed-9cf6edae7359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:49.127701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d2460-d482-4371-99ed-9cf6edae7359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:49.129139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d2460-d482-4371-99ed-9cf6edae7359 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:49.138838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1255/2523] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:49.168394 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:49.237526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20382e-2159-44a6-8048-9586a2be1b6f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:49.242210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:49.243120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:49.243402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:49.243677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] PATH_INFO: `/v3/users/ea2bdb67fd764b0285f0066383b11a7c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:49.244878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2bdb67fd764b0285f0066383b11a7c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:49.246803 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:49.472406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2bdb67fd764b0285f0066383b11a7c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:49.488090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2bdb67fd764b0285f0066383b11a7c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:49.489039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2bdb67fd764b0285f0066383b11a7c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:49.489835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2bdb67fd764b0285f0066383b11a7c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:49.610145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2bdb67fd764b0285f0066383b11a7c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:49.629715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1269/2524] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:49 2022] DELETE /identity/v3/users/ea2bdb67fd764b0285f0066383b11a7c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:49.634224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:49.635154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:49.635671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:49.663740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:49.664960 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:49.732131 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1256/2525] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:49.742540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:49.744507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:49.809519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5dd4-ae99-44ae-8291-a07499958a1d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:49.813460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:49.814126 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:49.814412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:49.814696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:49.824701 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:49.826327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:49.837277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1270/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:50.286913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:50.288934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:50.312634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58092-548a-4905-a330-25e97c9e175d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:50.314633 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:50.316079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:50.316783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:50.317284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] PATH_INFO: `/v3/projects/23677e4899e54d7cbb28d3ca6d4df245` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:50.318835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23677e4899e54d7cbb28d3ca6d4df245)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:50.321291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:50.479253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23677e4899e54d7cbb28d3ca6d4df245', 'request_id': 'req-aee962f3-229d-4df7-96ec-2d2b7ce20123'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.563985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23677e4899e54d7cbb28d3ca6d4df245', 'request_id': 'req-aee962f3-229d-4df7-96ec-2d2b7ce20123'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.571051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23677e4899e54d7cbb28d3ca6d4df245', 'request_id': 'req-aee962f3-229d-4df7-96ec-2d2b7ce20123'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.586605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] The token cache is being invalidate because project 23677e4899e54d7cbb28d3ca6d4df245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:50.587013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.587872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.589610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1257/2527] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:50 2022] DELETE /identity/v3/projects/23677e4899e54d7cbb28d3ca6d4df245 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:50.594888 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:50.605119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d6b8-5de2-420a-bd90-9d4592d1b90a service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:50.672706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:50.673670 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:50.674059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:50.674406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] PATH_INFO: `/v3/users/f65eba907f8441a1ab043630207ea506` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:50.675749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65eba907f8441a1ab043630207ea506)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:50.678053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:50.904634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65eba907f8441a1ab043630207ea506'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.916604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65eba907f8441a1ab043630207ea506'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.917328 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65eba907f8441a1ab043630207ea506'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:50.918062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65eba907f8441a1ab043630207ea506'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.003958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84a64ecd-3e8c-4d70-b7e7-b0abad8f0026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65eba907f8441a1ab043630207ea506'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.019132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1271/2528] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:50 2022] DELETE /identity/v3/users/f65eba907f8441a1ab043630207ea506 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:51.471869 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:51.473940 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:51.488123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee962f3-229d-4df7-96ec-2d2b7ce20123 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:51.550522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:51.551411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:51.551697 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:51.551975 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] PATH_INFO: `/v3/projects/284254d94fad49169f114a367af98786` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:51.553148 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=284254d94fad49169f114a367af98786)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:51.555121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:51.678764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284254d94fad49169f114a367af98786', 'request_id': 'req-6f284167-dced-4d1b-b75b-e05a29898323'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.752708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284254d94fad49169f114a367af98786', 'request_id': 'req-6f284167-dced-4d1b-b75b-e05a29898323'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.758474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284254d94fad49169f114a367af98786', 'request_id': 'req-6f284167-dced-4d1b-b75b-e05a29898323'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.776270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] The token cache is being invalidate because project 284254d94fad49169f114a367af98786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:51.776270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.776270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6f284167-dced-4d1b-b75b-e05a29898323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:51.776270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1258/2529] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:51 2022] DELETE /identity/v3/projects/284254d94fad49169f114a367af98786 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:51.779204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:51.780313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:51.780313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:51.798877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:51.804736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:51.871983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1272/2530] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:51.881913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:51.882205 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:51.882483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:51.904064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:51.906119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:51.916168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1259/2531] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:51.924008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:51.934894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27907-84e8-4889-bf14-87a4c555f488 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:51.940274 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:51.942530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:51.942530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:51.942530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:51.942530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:26:51.943111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:51.944267 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:51.959021 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1273/2532] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:26:51.962549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:51.977003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228330-1281-45b9-9e12-a3f31ce1098c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:51.978567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:51.979293 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:51.979674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:51.979985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:51.980704 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:51.982865 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.093018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1260/2533] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:51 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:52.097308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.108925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db997b-59cb-4474-9396-4bdfb2199b9b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.182706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.183387 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.183665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.183944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.184728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.187856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.304645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1274/2534] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:52 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:52.308735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.319827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ef44d-c42f-4be9-9bc9-66ec46d0cae7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.324378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.325032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.325318 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.325669 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.326330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.327963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.338347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1261/2535] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:52.342365 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.352651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f40e-cf54-4ff2-9b5d-242e0c166b35 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.358303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.361768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.362081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.362370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.363149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.368867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.369008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.369125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:52.379041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1275/2536] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:52.380170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.380898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec77db-c81a-4265-acbe-d679305000c4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.388325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.390159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.391894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.391894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] PATH_INFO: `/v3/users/480f3fa6c37b4d018ffa5803027d7be2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.392135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b0c1-fc62-4b36-b524-155842cb3005 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.392237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] RBAC: Authorizing `identity:delete_user(user_id=480f3fa6c37b4d018ffa5803027d7be2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.393989 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.396141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283eaba8-6411-43af-b023-c0752af78360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.397392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283eaba8-6411-43af-b023-c0752af78360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.397673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283eaba8-6411-43af-b023-c0752af78360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.397948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283eaba8-6411-43af-b023-c0752af78360 admin admin] PATH_INFO: `/v3/projects/0bfeb389a15a496fa86b1979f92206bb/users/b6ef836da1194f098e7a6eac99706dce/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.415308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283eaba8-6411-43af-b023-c0752af78360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfeb389a15a496fa86b1979f92206bb, user_id=b6ef836da1194f098e7a6eac99706dce, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.419441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283eaba8-6411-43af-b023-c0752af78360 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.521593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1276/2537] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:52 2022] PUT /identity/v3/projects/0bfeb389a15a496fa86b1979f92206bb/users/b6ef836da1194f098e7a6eac99706dce/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:52.532290 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.532567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.532845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.561110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] MFA Rules not processed for user `b6ef836da1194f098e7a6eac99706dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:52.562326 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:52.612495 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480f3fa6c37b4d018ffa5803027d7be2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:52.613493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480f3fa6c37b4d018ffa5803027d7be2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:52.625585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480f3fa6c37b4d018ffa5803027d7be2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:52.626285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480f3fa6c37b4d018ffa5803027d7be2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:52.628606 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1277/2538] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:52.633035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.692408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf9ef4-909d-4f2a-a26c-ed87dd6bf689 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.696999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.697645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.697925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.698195 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.698944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.700856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.703955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480f3fa6c37b4d018ffa5803027d7be2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:52.717161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1262/2539] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:26:52 2022] DELETE /identity/v3/users/480f3fa6c37b4d018ffa5803027d7be2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:52.782761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1278/2540] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:52 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:52.790224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.791720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:52.859966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c99b5-cc30-4721-bde1-305271f6511a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.917587 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.918237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.918518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.918889 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.919644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.922031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:52.965660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:52.967602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:52.981105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b5d1-dc43-4b72-896c-1c44c247cf63 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:52.986674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:52.988349 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:52.993427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:52.993427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] PATH_INFO: `/v3/projects/41ba2dfd59a64dc3b9f82fac37c1f278` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:52.993427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ba2dfd59a64dc3b9f82fac37c1f278)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:52.993427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.018830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1263/2541] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:52 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:53.022752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.033360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a44dc-7fd2-45a3-8fd2-d71f369195c5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.038372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.039080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.039366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.039648 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.040373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.041997 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.053023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1264/2542] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:53.057018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.067499 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ef5f2-1123-42bd-a4de-ebb89fdde56f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.072150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.073690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.073690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.073690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.074047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.075678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.086727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1265/2543] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:53.090792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.100872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580be66-5852-475e-a592-e0a0c45179e1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.113192 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ba2dfd59a64dc3b9f82fac37c1f278', 'request_id': 'req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:53.160036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c6b6-5eec-4f15-ab42-b4ef461d5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.160917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c6b6-5eec-4f15-ab42-b4ef461d5854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.161198 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c6b6-5eec-4f15-ab42-b4ef461d5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.161472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c6b6-5eec-4f15-ab42-b4ef461d5854 admin admin] PATH_INFO: `/v3/projects/e57313ebe3884080963f5613ceadf57c/users/9e96809874134ff18903ec97000a3d56/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.176016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c6b6-5eec-4f15-ab42-b4ef461d5854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57313ebe3884080963f5613ceadf57c, user_id=9e96809874134ff18903ec97000a3d56, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.178104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ba2dfd59a64dc3b9f82fac37c1f278', 'request_id': 'req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:53.178690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c6b6-5eec-4f15-ab42-b4ef461d5854 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.184158 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ba2dfd59a64dc3b9f82fac37c1f278', 'request_id': 'req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:53.198708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] The token cache is being invalidate because project 41ba2dfd59a64dc3b9f82fac37c1f278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:26:53.199026 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:53.199705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d1a9b91-f4f4-42d0-9f99-8a42ecbf80c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:26:53.201311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1279/2544] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:26:52 2022] DELETE /identity/v3/projects/41ba2dfd59a64dc3b9f82fac37c1f278 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:53.206197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e2b2-14d0-429c-94aa-4ddbfdfe5b92 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.206610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e2b2-14d0-429c-94aa-4ddbfdfe5b92 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.206978 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e2b2-14d0-429c-94aa-4ddbfdfe5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.225182 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-03c5e2b2-14d0-429c-94aa-4ddbfdfe5b92 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:53.226380 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-03c5e2b2-14d0-429c-94aa-4ddbfdfe5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:53.234965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1280/2545] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:53.243087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.243379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.243652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.261634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:53.262841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:53.270750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1281/2546] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:53.274815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.284189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dd24e-7034-4388-9617-72e977f67aea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.289137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.289761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.290037 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.290311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.291096 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:26:53.291417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.292989 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.293585 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1266/2547] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:53 2022] PUT /identity/v3/projects/e57313ebe3884080963f5613ceadf57c/users/9e96809874134ff18903ec97000a3d56/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:53.305524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.305813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.306096 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.308624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1282/2548] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:26:53.314120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.330076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b2b60-e61a-4ddf-8e43-86c2bd4946af admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.344005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] MFA Rules not processed for user `9e96809874134ff18903ec97000a3d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:53.345938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:53.398841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.399543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.399830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.400110 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.400799 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.402744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.416588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1267/2549] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:53.421681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.423047 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:53.436458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5a2d-ac30-46eb-8631-327a4c650071 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.441054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.441701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.441986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.442273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.443040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.444930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.496806 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1283/2550] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:53.501265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.554636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1268/2551] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:53.558805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.560598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bfc81-c667-45d7-95d2-cfa949f6e211 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.616608 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.617283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.617565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.617841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.618553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.620513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.621106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee046d-832a-4f72-9790-9b3b393490fd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.625736 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.626400 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.626687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.627020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.627738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.629665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.725303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1284/2552] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:53.729343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.738781 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf928-1e2c-46f7-9cfc-23ab85c3fa5c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.743722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.744359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.745575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.745575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.745830 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.747270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.747762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1269/2553] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:53.751578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.758329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1285/2554] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:53.761447 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fa321-feef-450a-be05-6ec3d5150b61 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.762266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.767038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.768267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.768568 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.768825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.769578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.771216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.773990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f25e5-e369-421c-a217-3121ba61d74e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.780592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.781401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.781697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.781979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.785147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1270/2555] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:53.785333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.785333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.786128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.795682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1286/2556] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:53.796319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d533e9-6097-41cd-993a-aef068bcd1c2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.800098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.801575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.802429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.802754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.803054 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] PATH_INFO: `/v3/projects/686ac382b45a426c98174fd9a86eedeb/users/796c24aa79b24f9ab77a1880ae3c4eb4/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.809765 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25382e07-54c3-4b89-a62f-88949627a512 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:53.814935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb53f81-0825-496f-b1f0-0354fb363948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:53.815905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53f81-0825-496f-b1f0-0354fb363948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.816188 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53f81-0825-496f-b1f0-0354fb363948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.816468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53f81-0825-496f-b1f0-0354fb363948 admin admin] PATH_INFO: `/v3/projects/2907ed4fc4604ddda877b02a117f5617/users/5ed885e1ffc4492a9cee9926228b598e/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.818953 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] RBAC: Authorizing `identity:create_grant(project_id=686ac382b45a426c98174fd9a86eedeb, user_id=796c24aa79b24f9ab77a1880ae3c4eb4, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.821630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.831429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53f81-0825-496f-b1f0-0354fb363948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2907ed4fc4604ddda877b02a117f5617, user_id=5ed885e1ffc4492a9cee9926228b598e, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:53.834081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53f81-0825-496f-b1f0-0354fb363948 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:53.884140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1271/2557] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:53 2022] PUT /identity/v3/projects/686ac382b45a426c98174fd9a86eedeb/users/796c24aa79b24f9ab77a1880ae3c4eb4/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:53.888121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:53.907591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1287/2558] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:53 2022] PUT /identity/v3/projects/2907ed4fc4604ddda877b02a117f5617/users/5ed885e1ffc4492a9cee9926228b598e/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:53.918079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:53.918368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:53.918648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:53.945314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] MFA Rules not processed for user `5ed885e1ffc4492a9cee9926228b598e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:53.946635 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:53.953982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2f0a-4bab-4224-babd-fc3a8fab600a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.009032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.009705 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.009994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.010274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.011024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.011487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1288/2559] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:54.012826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.016070 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.024256 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1272/2560] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:54.026116 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e606a1-36ef-4451-b366-b1e1c1760f3a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.028097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.031980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.032624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.032908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.033177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.033854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.035775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.038868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa9577-7ebe-4efe-a3f2-553e7cfe3cb2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.043892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068209-fd4a-4c83-8ddc-a0762a3a97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.044819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068209-fd4a-4c83-8ddc-a0762a3a97b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.045216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068209-fd4a-4c83-8ddc-a0762a3a97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.045501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068209-fd4a-4c83-8ddc-a0762a3a97b0 admin admin] PATH_INFO: `/v3/projects/686ac382b45a426c98174fd9a86eedeb/users/796c24aa79b24f9ab77a1880ae3c4eb4/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.047529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068209-fd4a-4c83-8ddc-a0762a3a97b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686ac382b45a426c98174fd9a86eedeb, user_id=796c24aa79b24f9ab77a1880ae3c4eb4, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.050156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068209-fd4a-4c83-8ddc-a0762a3a97b0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.060938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1273/2561] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:54 2022] PUT /identity/v3/projects/686ac382b45a426c98174fd9a86eedeb/users/796c24aa79b24f9ab77a1880ae3c4eb4/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:54.071573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.071855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.072129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.098786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] MFA Rules not processed for user `796c24aa79b24f9ab77a1880ae3c4eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:54.100045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:54.117802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1289/2562] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:26:54 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:26:54.121696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.170064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1274/2563] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:26:54.182146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.183606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:54.186709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541bef-aa63-4804-9645-c8c98e83f384 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.191703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.192377 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.192665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.192945 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.193675 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.195695 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.240547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d9e0-2c83-468b-af90-d33aa4a3fc20 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.277904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1290/2564] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:26:54 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:26:54.281868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.289593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.290278 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.290562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.290840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.292169 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986758ee-12f0-4c45-b049-a24a22bb58b8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.292825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:54.297356 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.298006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.298313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.298580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.299340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.300940 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.312035 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1291/2565] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:26:54.315679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.325355 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea096-d819-49af-845f-4da012cb38b4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.330755 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.331687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.331976 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.332254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] PATH_INFO: `/v3/projects/ecccdcadf1884366a0dcb354549869fb/users/446bdedc999e46ed99ccb3c467fcf1e5/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.347386 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecccdcadf1884366a0dcb354549869fb, user_id=446bdedc999e46ed99ccb3c467fcf1e5, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.350038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.357243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.359220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.368501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1275/2566] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:26:54.492883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1292/2567] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:54 2022] PUT /identity/v3/projects/ecccdcadf1884366a0dcb354549869fb/users/446bdedc999e46ed99ccb3c467fcf1e5/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:26:54.497040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.508764 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e1e4-fccd-4458-bb3b-cc5bead99d58 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.566144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5d88-6143-41ca-ac55-7ff44fc24b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.566735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5d88-6143-41ca-ac55-7ff44fc24b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.567049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5d88-6143-41ca-ac55-7ff44fc24b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.567333 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5d88-6143-41ca-ac55-7ff44fc24b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.568059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5d88-6143-41ca-ac55-7ff44fc24b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.569665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5d88-6143-41ca-ac55-7ff44fc24b6c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.579902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1276/2568] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:26:54.584162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.594426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804365d-e10a-42f6-97ac-4d5ab82d7c0b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.599298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.600263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.600546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.600829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] PATH_INFO: `/v3/projects/ecccdcadf1884366a0dcb354549869fb/users/446bdedc999e46ed99ccb3c467fcf1e5/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.603412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecccdcadf1884366a0dcb354549869fb, user_id=446bdedc999e46ed99ccb3c467fcf1e5, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.605580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.617030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1293/2569] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:26:54 2022] PUT /identity/v3/projects/ecccdcadf1884366a0dcb354549869fb/users/446bdedc999e46ed99ccb3c467fcf1e5/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:26:54.629667 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.630454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.630642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.658728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] MFA Rules not processed for user `446bdedc999e46ed99ccb3c467fcf1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:26:54.659972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:54.728052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1277/2570] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:26:54.740537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:54.742243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:54.801908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989fad-93d6-494a-8e02-e5ccf700f65d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:54.805939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:54.806586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:54.806899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:54.807218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:54.816841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:54.818210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:54.827710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1294/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:55.062798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:55.072524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780af73-f7b5-4cb3-a516-d1ba58ebf78a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:55.076032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:55.076770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:55.077057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:55.077334 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:55.135456 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:55.136885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:55.146673 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1278/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:56.342871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:56.351342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3541-a712-4115-9738-708c30c845fc service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:56.355382 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:56.356030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:56.356322 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:56.356619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:56.415108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:56.416559 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:56.425882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1295/2573] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:56.580103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:56.588971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362ca1-918d-406f-a191-64965be4f16a service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:56.593099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:56.593751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:56.594068 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:56.594349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:56.596209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:26:56.683635 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:56.685105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:56.709395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1279/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:26:58.054487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:26:58.064575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0a51-fe9d-49e1-a181-44f5526e9147 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:26:58.068404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625b441-0854-4901-8007-3ed810ac58bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:26:58.069054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625b441-0854-4901-8007-3ed810ac58bd service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:26:58.069340 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625b441-0854-4901-8007-3ed810ac58bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:26:58.069617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625b441-0854-4901-8007-3ed810ac58bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:26:58.132367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625b441-0854-4901-8007-3ed810ac58bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:26:58.133837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625b441-0854-4901-8007-3ed810ac58bd service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:26:58.144832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1296/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:26:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:05.995269 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:06.060733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a66c43-d5be-462a-8b6a-424df18ff82b service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:06.065962 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:06.066821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:06.067134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:06.067459 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] PATH_INFO: `/v3/users/b6ef836da1194f098e7a6eac99706dce` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:06.068676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ef836da1194f098e7a6eac99706dce)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:06.070694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:06.308338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ef836da1194f098e7a6eac99706dce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:06.308983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ef836da1194f098e7a6eac99706dce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:06.321583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ef836da1194f098e7a6eac99706dce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:06.322209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ef836da1194f098e7a6eac99706dce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:06.439691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ef836da1194f098e7a6eac99706dce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:06.453043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1280/2576] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:05 2022] DELETE /identity/v3/users/b6ef836da1194f098e7a6eac99706dce => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:06.458478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:06.459020 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:06.459141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:06.477333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:06.478570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:06.540277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1297/2577] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:06.550696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:06.552141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:06.613052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646bd4b-ed58-46ef-93bd-87047e0e3195 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:06.616908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:06.617559 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:06.617970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:06.622826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:06.629634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:06.630650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:06.641598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1281/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:07.065576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:07.069648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:07.079845 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7551c-4711-4854-8cec-d9a3066bac78 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:07.085332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:07.086207 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:07.086499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:07.087139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] PATH_INFO: `/v3/projects/0bfeb389a15a496fa86b1979f92206bb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:07.092431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bfeb389a15a496fa86b1979f92206bb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:07.092431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:07.201238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bfeb389a15a496fa86b1979f92206bb', 'request_id': 'req-071aa6bb-398e-4cff-adf3-8d11f2f937bf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.292460 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bfeb389a15a496fa86b1979f92206bb', 'request_id': 'req-071aa6bb-398e-4cff-adf3-8d11f2f937bf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.299315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bfeb389a15a496fa86b1979f92206bb', 'request_id': 'req-071aa6bb-398e-4cff-adf3-8d11f2f937bf'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.310445 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] The token cache is being invalidate because project 0bfeb389a15a496fa86b1979f92206bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:07.310738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.311412 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.313748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1298/2579] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:07 2022] DELETE /identity/v3/projects/0bfeb389a15a496fa86b1979f92206bb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:07.317727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:07.328342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0914f-9f1a-4cca-b13e-b743bc9fb77d service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:07.387582 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:07.388455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:07.388730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:07.393755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] PATH_INFO: `/v3/users/9e96809874134ff18903ec97000a3d56` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:07.393755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e96809874134ff18903ec97000a3d56)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:07.393755 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:07.655153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e96809874134ff18903ec97000a3d56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.655824 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e96809874134ff18903ec97000a3d56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.668921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e96809874134ff18903ec97000a3d56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.669592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e96809874134ff18903ec97000a3d56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.743691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e96809874134ff18903ec97000a3d56'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:07.757379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1282/2580] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:07 2022] DELETE /identity/v3/users/9e96809874134ff18903ec97000a3d56 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:08.205421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:08.208447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.227534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aa6bb-398e-4cff-adf3-8d11f2f937bf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:08.281184 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:08.282308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:08.282598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:08.282877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] PATH_INFO: `/v3/projects/e57313ebe3884080963f5613ceadf57c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:08.284175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57313ebe3884080963f5613ceadf57c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:08.286094 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:08.323709 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:08.325097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.337520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2dfe4-9923-4d77-95d6-07e42d12d1c8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:08.342048 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:08.343765 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:08.343926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:08.344150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] PATH_INFO: `/v3/users/5ed885e1ffc4492a9cee9926228b598e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:08.345361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed885e1ffc4492a9cee9926228b598e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:08.347401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:08.420918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57313ebe3884080963f5613ceadf57c', 'request_id': 'req-24a8abe8-0744-41e0-8f88-3082dc49ceed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.512278 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57313ebe3884080963f5613ceadf57c', 'request_id': 'req-24a8abe8-0744-41e0-8f88-3082dc49ceed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.519320 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57313ebe3884080963f5613ceadf57c', 'request_id': 'req-24a8abe8-0744-41e0-8f88-3082dc49ceed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.530135 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] The token cache is being invalidate because project e57313ebe3884080963f5613ceadf57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:08.530422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.531215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.532753 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1299/2581] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:08 2022] DELETE /identity/v3/projects/e57313ebe3884080963f5613ceadf57c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:08.534273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:08.535703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.591780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8abe8-0744-41e0-8f88-3082dc49ceed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:08.595585 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:08.596238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:08.596528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:08.596805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:08.598556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.600479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed885e1ffc4492a9cee9926228b598e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.601117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed885e1ffc4492a9cee9926228b598e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.614129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed885e1ffc4492a9cee9926228b598e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.615015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed885e1ffc4492a9cee9926228b598e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.662033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:08.663770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:08.666209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f3a733c4-3c22-4fa0-b2d4-8d9be543ee38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed885e1ffc4492a9cee9926228b598e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.674858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1300/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:08.675764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:08.677248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.680296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1283/2583] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:08 2022] DELETE /identity/v3/users/5ed885e1ffc4492a9cee9926228b598e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:08.684545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:08.685032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:08.685492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:08.689581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96973ef7-e344-44f8-a1a2-b1fdef2f3451 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:08.704922 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:08.706213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.749952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:08.750838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:08.751154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:08.751431 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] PATH_INFO: `/v3/users/796c24aa79b24f9ab77a1880ae3c4eb4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:08.752718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796c24aa79b24f9ab77a1880ae3c4eb4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:08.754642 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:08.776893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1284/2584] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:08.784488 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:08.785905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:08.845004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bed06-06e0-44aa-bbac-ad24d3942e99 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:08.849451 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:08.850554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:08.851122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:08.851653 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:08.868204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:08.869663 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:08.880661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1285/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:08.955590 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796c24aa79b24f9ab77a1880ae3c4eb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.968988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796c24aa79b24f9ab77a1880ae3c4eb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.970502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796c24aa79b24f9ab77a1880ae3c4eb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:08.971208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796c24aa79b24f9ab77a1880ae3c4eb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:09.066769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796c24aa79b24f9ab77a1880ae3c4eb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:09.079846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1301/2586] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:08 2022] DELETE /identity/v3/users/796c24aa79b24f9ab77a1880ae3c4eb4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:09.739713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:09.741308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:09.754412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9de14-af4e-467a-984d-10869fb2d9e7 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:09.814708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:09.816031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:09.816487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:09.817338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] PATH_INFO: `/v3/projects/2907ed4fc4604ddda877b02a117f5617` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:09.819025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2907ed4fc4604ddda877b02a117f5617)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:09.820875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:09.967808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2907ed4fc4604ddda877b02a117f5617', 'request_id': 'req-4b575560-33ad-44de-a164-473a23ab325a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.011128 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.014172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:10.026706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2907ed4fc4604ddda877b02a117f5617', 'request_id': 'req-4b575560-33ad-44de-a164-473a23ab325a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.028203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d11fb-4598-4b72-b098-bda0e9bdad76 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.032885 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2907ed4fc4604ddda877b02a117f5617', 'request_id': 'req-4b575560-33ad-44de-a164-473a23ab325a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.045398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] The token cache is being invalidate because project 2907ed4fc4604ddda877b02a117f5617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:10.045692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.046492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.048747 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1286/2587] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:09 2022] DELETE /identity/v3/projects/2907ed4fc4604ddda877b02a117f5617 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:10.052380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.053797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:10.088561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.089713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.090009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.090291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] PATH_INFO: `/v3/projects/686ac382b45a426c98174fd9a86eedeb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.093686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686ac382b45a426c98174fd9a86eedeb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.095698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.137936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b575560-33ad-44de-a164-473a23ab325a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.143740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.144751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.145172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.145482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] PATH_INFO: `/v3/users/446bdedc999e46ed99ccb3c467fcf1e5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.146843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446bdedc999e46ed99ccb3c467fcf1e5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.148878 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.227336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686ac382b45a426c98174fd9a86eedeb', 'request_id': 'req-ce7d554d-e303-48d8-bb26-7735e35a2604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.298605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686ac382b45a426c98174fd9a86eedeb', 'request_id': 'req-ce7d554d-e303-48d8-bb26-7735e35a2604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.304903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686ac382b45a426c98174fd9a86eedeb', 'request_id': 'req-ce7d554d-e303-48d8-bb26-7735e35a2604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.318097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] The token cache is being invalidate because project 686ac382b45a426c98174fd9a86eedeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:10.318628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.319329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ce7d554d-e303-48d8-bb26-7735e35a2604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.320972 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1302/2588] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:10 2022] DELETE /identity/v3/projects/686ac382b45a426c98174fd9a86eedeb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:10.326212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2f311-d21a-401f-823a-28c88a2e9ac9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.327097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2f311-d21a-401f-823a-28c88a2e9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.327641 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2f311-d21a-401f-823a-28c88a2e9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.346248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-85f2f311-d21a-401f-823a-28c88a2e9ac9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:10.347527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-85f2f311-d21a-401f-823a-28c88a2e9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:10.377619 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446bdedc999e46ed99ccb3c467fcf1e5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.378232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446bdedc999e46ed99ccb3c467fcf1e5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.395411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446bdedc999e46ed99ccb3c467fcf1e5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.396426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446bdedc999e46ed99ccb3c467fcf1e5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.410390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1303/2589] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:10.418472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.418771 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.419087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.439707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:10.440912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:10.449009 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1304/2590] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:10.454468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.463615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4947fc-2b7e-4ad5-a9cf-5c7c3b9ad148 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.469631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.470305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.470595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.470921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.471685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:10.472000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.473636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.486444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1305/2591] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:27:10.490742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.501410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b711-8416-4ba7-be5f-522154925e78 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.506240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.506905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.507224 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.507613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.508423 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.509162 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446bdedc999e46ed99ccb3c467fcf1e5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:10.513622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.524150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1287/2592] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:10 2022] DELETE /identity/v3/users/446bdedc999e46ed99ccb3c467fcf1e5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:10.622369 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.624012 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1306/2593] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:10 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:10.718564 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9280e-118e-4b05-8fc1-b0124fad5428 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.793412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.794731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.795119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.795467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.797236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.800870 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.883020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1288/2594] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:10 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:10.883813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.899254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33209ffa-62a0-4266-b9e8-8cba96be45de admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.905385 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.906503 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.907783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.907783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.908028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.909442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.923023 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1307/2595] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:10.925541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.935732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a739-18b0-40a9-a56e-10ecfa149735 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.941262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.941941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.942373 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.942647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:10.943413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:10.944995 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:10.955971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1289/2596] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:10.960102 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.968024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:10.970423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:10.970965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205a7e9-3b4d-479f-84fb-06c9e21653e9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:10.976215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1b914-dc1c-40df-ac8a-a449960917c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:10.977441 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1b914-dc1c-40df-ac8a-a449960917c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:10.977745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1b914-dc1c-40df-ac8a-a449960917c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:10.978150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1b914-dc1c-40df-ac8a-a449960917c2 admin admin] PATH_INFO: `/v3/projects/7fc468a8968d43ba9fd073e679cf3793/users/8c6b10786bf4490090af27618dcf62c6/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.007076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1b914-dc1c-40df-ac8a-a449960917c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc468a8968d43ba9fd073e679cf3793, user_id=8c6b10786bf4490090af27618dcf62c6, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.012834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1b914-dc1c-40df-ac8a-a449960917c2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.015847 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1a774-fc7e-4dcd-9e0d-bda5be6d5a59 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.023923 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.025019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.025798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.026080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] PATH_INFO: `/v3/projects/ecccdcadf1884366a0dcb354549869fb` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.027706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecccdcadf1884366a0dcb354549869fb)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.029908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.121669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1308/2597] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:10 2022] PUT /identity/v3/projects/7fc468a8968d43ba9fd073e679cf3793/users/8c6b10786bf4490090af27618dcf62c6/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:11.126212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.126212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.126392 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.163827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecccdcadf1884366a0dcb354549869fb', 'request_id': 'req-9192f061-f287-4ec1-aaf3-4bbdb396368d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.168766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] MFA Rules not processed for user `8c6b10786bf4490090af27618dcf62c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:11.170179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.243649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1309/2598] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:11.252018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecccdcadf1884366a0dcb354549869fb', 'request_id': 'req-9192f061-f287-4ec1-aaf3-4bbdb396368d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.255872 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.259609 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.260091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecccdcadf1884366a0dcb354549869fb', 'request_id': 'req-9192f061-f287-4ec1-aaf3-4bbdb396368d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.275510 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] The token cache is being invalidate because project ecccdcadf1884366a0dcb354549869fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:11.276833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.277726 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9192f061-f287-4ec1-aaf3-4bbdb396368d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.280115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1290/2599] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:10 2022] DELETE /identity/v3/projects/ecccdcadf1884366a0dcb354549869fb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:11.285336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.287308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.287893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.308144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:11.309433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.340131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503098-a805-4b67-b3fa-f48636165d92 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.346296 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.348987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.348987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.348987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.349287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.361703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.363350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c0930-acca-4cbe-8fcc-4fa195b29441 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.373108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1310/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:11.387812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1291/2601] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:11.399715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.399715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.399715 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.400837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.402218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.414571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0873fd-a7bc-415d-88a4-bad99bac55b6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.415827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:11.417271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.419553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.420418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.420702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.420982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] PATH_INFO: `/v3/users/8c6b10786bf4490090af27618dcf62c6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.422783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6b10786bf4490090af27618dcf62c6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.424737 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.426315 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1311/2602] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:11.430634 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.447243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788751ca-66ab-4fb1-a07e-5ee8565be24a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.454222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.455013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.455360 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.455696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.456484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:11.456882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.458611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.477264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1312/2603] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:27:11.481473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.491956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9949-fde2-4d90-b573-9964ee2a8703 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.496661 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.497319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.497603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.497877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.498576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.500573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.612291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1313/2604] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:11 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:11.616542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.637105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6b10786bf4490090af27618dcf62c6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.637105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6b10786bf4490090af27618dcf62c6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.654000 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6b10786bf4490090af27618dcf62c6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.655255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6b10786bf4490090af27618dcf62c6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.691451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d1df-c186-41f2-ab3e-4d44b9eec219 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.696250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.696934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.697221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.697516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.698193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.700275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.741134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6d5ef788-123d-4c8d-ac4c-39566eb3ce8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6b10786bf4490090af27618dcf62c6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:11.755177 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1292/2605] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:11 2022] DELETE /identity/v3/users/8c6b10786bf4490090af27618dcf62c6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:11.759794 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.760084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.760366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.778770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:11.780084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.836019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1314/2606] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:11 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:11.840762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.842538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.858301 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1293/2607] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:11.860553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fcf-06bc-4a96-8618-48b33c1a14f2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.869284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.870084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.870428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.870774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.870967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.871683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.872996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:11.873509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.885681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1315/2608] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:11.889509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.900679 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338419d-337c-41e1-ba87-644bb4efc151 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.910338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.911255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.911615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.911966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.913218 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.914924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.927986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1316/2609] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:11.932329 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:11.942617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed40ba-395a-4240-a589-72f2d0cf3aa9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.945315 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca086-7e18-41b9-8ab3-ef138f8e0b44 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:11.948013 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.948963 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.949308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.949486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8746-4a03-4ad5-9240-2cd7d6e566e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:11.949712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] PATH_INFO: `/v3/projects/d559534e9f69475ab2668f2533cf09b4/users/92ce1b1f825042afa3ac6f2086942e31/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.950136 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8746-4a03-4ad5-9240-2cd7d6e566e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:11.950479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8746-4a03-4ad5-9240-2cd7d6e566e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:11.950768 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8746-4a03-4ad5-9240-2cd7d6e566e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:11.962230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8746-4a03-4ad5-9240-2cd7d6e566e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.964070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8746-4a03-4ad5-9240-2cd7d6e566e0 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.969738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d559534e9f69475ab2668f2533cf09b4, user_id=92ce1b1f825042afa3ac6f2086942e31, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:11.973087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:11.977150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1294/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:12.048718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1317/2611] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:11 2022] PUT /identity/v3/projects/d559534e9f69475ab2668f2533cf09b4/users/92ce1b1f825042afa3ac6f2086942e31/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:12.059467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.060114 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.060581 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.096056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] MFA Rules not processed for user `92ce1b1f825042afa3ac6f2086942e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:12.097434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:12.168286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1295/2612] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:12.174527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.268265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb11693-0a25-4b8d-9132-32a453063707 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.274967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.275440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.275730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.276001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.276702 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.279014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.376068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1318/2613] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:12 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:12.376279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.387060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421921-7d30-4157-a4da-5772fe8033af None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.458535 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.459349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.459754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.460241 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.461020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.463298 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.558440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1296/2614] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:12 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:12.559681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.570501 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340183a-01ee-4f61-8e38-5df934bb31d9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.576805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.578146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.578788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.579492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.582649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.582649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.596818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1319/2615] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:12.598043 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.608031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7b4eb-d740-406a-b5af-00c6b277b69b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.613326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.614211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.614504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.614788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] PATH_INFO: `/v3/projects/b02d70e27088485cbde6aa95dee38b2b/users/98d990c87bb545aaa19fe794f21ca49a/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.634325 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02d70e27088485cbde6aa95dee38b2b, user_id=98d990c87bb545aaa19fe794f21ca49a, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.637109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.642406 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.644239 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:12.658253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b01c1d-cde1-42d9-999a-a76fcd221705 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.663243 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.664131 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.664440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.664728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] PATH_INFO: `/v3/projects/7fc468a8968d43ba9fd073e679cf3793` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.666196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc468a8968d43ba9fd073e679cf3793)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.668343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.765522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1297/2616] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:12 2022] PUT /identity/v3/projects/b02d70e27088485cbde6aa95dee38b2b/users/98d990c87bb545aaa19fe794f21ca49a/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:12.769846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.813139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc468a8968d43ba9fd073e679cf3793', 'request_id': 'req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:12.845349 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c2de-a6a7-4db7-b039-1e6f9f83e419 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.883591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc468a8968d43ba9fd073e679cf3793', 'request_id': 'req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:12.890499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc468a8968d43ba9fd073e679cf3793', 'request_id': 'req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:12.903319 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.904005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.904284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] The token cache is being invalidate because project 7fc468a8968d43ba9fd073e679cf3793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:12.906046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.906046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.906266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:12.906266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b5bbe53d-97db-4cf4-a35b-e5dd05191f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:12.906475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.907652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.911272 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1320/2617] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:12 2022] DELETE /identity/v3/projects/7fc468a8968d43ba9fd073e679cf3793 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:12.913502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5e673-3705-4057-a8f9-871f27e91716 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.913954 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5e673-3705-4057-a8f9-871f27e91716 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.914325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5e673-3705-4057-a8f9-871f27e91716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.923578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1298/2618] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:12.924470 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:12.927125 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:12.939053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-14c5e673-3705-4057-a8f9-871f27e91716 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:12.939936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2d45-473f-4fb2-8ef2-2c549fbcf5e0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:12.940292 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-14c5e673-3705-4057-a8f9-871f27e91716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:12.944935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e7b44-0eed-4106-a542-5be0325db7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:12.945798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e7b44-0eed-4106-a542-5be0325db7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.946082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e7b44-0eed-4106-a542-5be0325db7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.946361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e7b44-0eed-4106-a542-5be0325db7ed admin admin] PATH_INFO: `/v3/projects/b02d70e27088485cbde6aa95dee38b2b/users/98d990c87bb545aaa19fe794f21ca49a/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.948599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e7b44-0eed-4106-a542-5be0325db7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02d70e27088485cbde6aa95dee38b2b, user_id=98d990c87bb545aaa19fe794f21ca49a, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:12.949893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1321/2619] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:12.951642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e7b44-0eed-4106-a542-5be0325db7ed admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:12.957908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.958295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.958583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.963317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1299/2620] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:12 2022] PUT /identity/v3/projects/b02d70e27088485cbde6aa95dee38b2b/users/98d990c87bb545aaa19fe794f21ca49a/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:12.979600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:12.979896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:12.980182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:12.984729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:12.986051 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.007727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] MFA Rules not processed for user `98d990c87bb545aaa19fe794f21ca49a`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:13.008929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.048237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1322/2621] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:13.052533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.063242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1e07-2d31-4197-b11a-55d0054779a4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.072761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.073687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.074168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.074453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.075350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:13.075786 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.078639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.091024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1300/2622] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:13.092147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.095497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1323/2623] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:27:13.096420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.096630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.108547 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a481b9-a26c-40f3-bd7c-a41e570d08ab admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.112267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4fbad-9d22-46cb-9dee-955a308ab701 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.114215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.114870 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.115203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.116359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.117083 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.119038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.119154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.120986 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.124419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.124419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] PATH_INFO: `/v3/users/ba28b51976a54c89ac3beb5394b1ec76` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.124419 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba28b51976a54c89ac3beb5394b1ec76)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.125580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.208462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1324/2624] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:13 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:13.209311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.210848 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.270144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c39ca-8e77-4457-abb8-549e2180df1a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.273775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.274407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.274688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.274961 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.310915 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba28b51976a54c89ac3beb5394b1ec76'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.311723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba28b51976a54c89ac3beb5394b1ec76'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.323836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba28b51976a54c89ac3beb5394b1ec76'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.324517 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba28b51976a54c89ac3beb5394b1ec76'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.336134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.337651 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.347720 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1325/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:13.348455 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.410914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995b6a1-a26c-448e-8406-5ae0092187e0 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.415882 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.416555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.416837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.417115 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.417801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.419833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.420620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba28b51976a54c89ac3beb5394b1ec76'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.434790 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1301/2626] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:13 2022] DELETE /identity/v3/users/ba28b51976a54c89ac3beb5394b1ec76 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:13.435761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.437157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.505357 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f46f-a7aa-4533-8024-5da41fd5eb86 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.510711 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.511817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.512195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.512476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] PATH_INFO: `/v3/users/92ce1b1f825042afa3ac6f2086942e31` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.513759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ce1b1f825042afa3ac6f2086942e31)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.516387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.539044 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1326/2627] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:13 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:13.541557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.543721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.557909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d331-fd16-407f-aaed-0dad1114d47d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.563384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.564043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.564982 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.565260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.565987 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.567614 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.582091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1327/2628] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:13.583465 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.594197 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb76ad8-1981-4f50-99e8-5cf50eb693fc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.598902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.599583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.599865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.600138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.600849 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.602443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.614368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1328/2629] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:13.618688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.629479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e532-600b-4448-af73-32a78800cc94 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.635298 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.636170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.636453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.636769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] PATH_INFO: `/v3/projects/7b90f4bf16694a2d9d5999f3f8870912/users/8619dd8583734dfcb6d1eec3f1075b10/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.652343 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b90f4bf16694a2d9d5999f3f8870912, user_id=8619dd8583734dfcb6d1eec3f1075b10, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.655095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.738332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ce1b1f825042afa3ac6f2086942e31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.739098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ce1b1f825042afa3ac6f2086942e31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.751172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ce1b1f825042afa3ac6f2086942e31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.751814 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ce1b1f825042afa3ac6f2086942e31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.798418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1329/2630] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:13 2022] PUT /identity/v3/projects/7b90f4bf16694a2d9d5999f3f8870912/users/8619dd8583734dfcb6d1eec3f1075b10/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:13.799295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.800868 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.820694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0bea5044-66dc-4f53-8078-a7e43ff5951d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ce1b1f825042afa3ac6f2086942e31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:13.834511 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1302/2631] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:13 2022] DELETE /identity/v3/users/92ce1b1f825042afa3ac6f2086942e31 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:13.837838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ce38e-55ed-4011-8b78-fb97483f0467 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.837838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ce38e-55ed-4011-8b78-fb97483f0467 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.837838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ce38e-55ed-4011-8b78-fb97483f0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.864076 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9d5ce38e-55ed-4011-8b78-fb97483f0467 None None] MFA Rules not processed for user `8619dd8583734dfcb6d1eec3f1075b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:13.865429 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9d5ce38e-55ed-4011-8b78-fb97483f0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.865768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db95386-1c59-477d-bcda-35f819306396 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:13.920764 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:13.922174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.922464 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.922749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] PATH_INFO: `/v3/projects/1437e10b84d943a885db1ec25dccc6e5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.924000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1437e10b84d943a885db1ec25dccc6e5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:13.925919 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:13.930630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1303/2632] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:13.932016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:13.932320 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:13.932606 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:13.951430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:13.952969 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:13.960862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1304/2633] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:13.961769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:13.962963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.019402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce2b77-517c-484b-a1e0-0b9758ffaa51 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.023007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.023678 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.023946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.024224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.033265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.034691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.043851 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1305/2634] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:14.044732 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.046555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.057732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1437e10b84d943a885db1ec25dccc6e5', 'request_id': 'req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.104006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bea493-fd1e-4543-b589-d7ad8f4e0f7d service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.117538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1437e10b84d943a885db1ec25dccc6e5', 'request_id': 'req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.123921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1437e10b84d943a885db1ec25dccc6e5', 'request_id': 'req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.135929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] The token cache is being invalidate because project 1437e10b84d943a885db1ec25dccc6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:14.136354 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.137099 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a685feb0-b256-4fa7-b3d5-18d2a3cfc3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.139022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1330/2635] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:13 2022] DELETE /identity/v3/projects/1437e10b84d943a885db1ec25dccc6e5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:14.143631 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38ee7-5872-4a91-a601-554ad4a62b4f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.144016 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38ee7-5872-4a91-a601-554ad4a62b4f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.144393 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38ee7-5872-4a91-a601-554ad4a62b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.157111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.157774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.158058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.158336 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.160215 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.163885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d2d38ee7-5872-4a91-a601-554ad4a62b4f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:14.165145 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d2d38ee7-5872-4a91-a601-554ad4a62b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.226010 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1331/2636] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:14.228728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.230209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.236865 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.237405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.237687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.242129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1306/2637] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:14.257229 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:14.258523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.267191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1332/2638] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:14.271591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.282774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d46d-793d-43c2-9d89-c64343131cb3 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.288275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.288523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.288775 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.289052 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.289813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:14.290299 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.291918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.308051 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1307/2639] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:27:14.309327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.319653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e0da-06f1-402a-b23d-160b96de0cbe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.324367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.325027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.325316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.325586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.326277 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.328788 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.409893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1333/2640] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:14 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:14.415708 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.426849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a9400-cdb6-4501-80fc-2fac300778ff admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.487026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.488087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.488375 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.488656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.489356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.491314 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.598508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1308/2641] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:14 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:14.603140 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.614517 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0a13-531b-4646-b9eb-2ccd510c8712 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.619576 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.620253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.620539 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.620815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.621546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.623213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.635492 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1334/2642] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:14.647119 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.651268 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d5d9-54d8-484d-a4e7-89f068a2f57f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.662624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.662624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.662624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.662624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.663035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.663035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.664669 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.667495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.676577 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1309/2643] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:14.680601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.685081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3ed75-01d5-43cb-94f9-cb121aea8e0e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.692748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.693142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.693399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.693744 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] PATH_INFO: `/v3/projects/d559534e9f69475ab2668f2533cf09b4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.694209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2cb58-a3b2-45d7-a5d8-2b43e8b18b23 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:14.694853 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d559534e9f69475ab2668f2533cf09b4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.696796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.699270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187f983-7785-4be3-92d3-02bd89abb6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:14.700103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187f983-7785-4be3-92d3-02bd89abb6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.700387 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187f983-7785-4be3-92d3-02bd89abb6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.700659 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187f983-7785-4be3-92d3-02bd89abb6a7 admin admin] PATH_INFO: `/v3/projects/849349c60f6a48ee8e7e38b47c443e6e/users/afece24e3cea4d11b46219fea43797e7/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.717840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187f983-7785-4be3-92d3-02bd89abb6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849349c60f6a48ee8e7e38b47c443e6e, user_id=afece24e3cea4d11b46219fea43797e7, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:14.720797 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187f983-7785-4be3-92d3-02bd89abb6a7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:14.795493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1310/2644] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:14 2022] PUT /identity/v3/projects/849349c60f6a48ee8e7e38b47c443e6e/users/afece24e3cea4d11b46219fea43797e7/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:14.805896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:14.806188 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:14.806467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:14.833311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] MFA Rules not processed for user `afece24e3cea4d11b46219fea43797e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:14.834798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.855719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd559534e9f69475ab2668f2533cf09b4', 'request_id': 'req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.901057 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1311/2645] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:14.905573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.938114 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd559534e9f69475ab2668f2533cf09b4', 'request_id': 'req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.944409 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd559534e9f69475ab2668f2533cf09b4', 'request_id': 'req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.955879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] The token cache is being invalidate because project d559534e9f69475ab2668f2533cf09b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:14.956196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.956878 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:14.958468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1335/2646] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:14 2022] DELETE /identity/v3/projects/d559534e9f69475ab2668f2533cf09b4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:14.962514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:14.964004 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:14.967087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a806d-7184-4d3f-bdf3-650b4fd0b08c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.024554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.025270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.025553 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.025830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.026519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.028398 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c03925-cc2a-4de2-9b8c-ae54f9cfa8ac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.028541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.036648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.037818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.038162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.038439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] PATH_INFO: `/v3/users/98d990c87bb545aaa19fe794f21ca49a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.039640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d990c87bb545aaa19fe794f21ca49a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.041664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.133684 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1312/2647] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:14 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:15.138100 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.140396 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:15.201463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20040-85ed-4163-87f1-6277db35bac6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.207518 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.208189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.208471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.208746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.209439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.211458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.231257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d990c87bb545aaa19fe794f21ca49a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:15.236390 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d990c87bb545aaa19fe794f21ca49a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:15.237073 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d990c87bb545aaa19fe794f21ca49a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:15.237704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d990c87bb545aaa19fe794f21ca49a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:15.309135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1313/2648] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:15 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:15.312244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d990c87bb545aaa19fe794f21ca49a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:15.313762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.315498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:15.325484 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1336/2649] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:14 2022] DELETE /identity/v3/users/98d990c87bb545aaa19fe794f21ca49a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:15.334464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dcba2-3f2a-46c5-b28c-95a39193477f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.393417 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.394094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.394376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.394782 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.395542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.397170 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.407573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1314/2650] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:15.412053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.422376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331c7a4-c54b-4b07-bc8d-958a642e9e5b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.426937 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.427983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.428264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.428536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] PATH_INFO: `/v3/projects/1bf15a3937d64c30b878881ead1fdfe8/users/bba5b69e615046d2afb8e6c01424d5a1/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.444485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf15a3937d64c30b878881ead1fdfe8, user_id=bba5b69e615046d2afb8e6c01424d5a1, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.447191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.507265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1337/2651] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:15 2022] PUT /identity/v3/projects/1bf15a3937d64c30b878881ead1fdfe8/users/bba5b69e615046d2afb8e6c01424d5a1/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:15.511168 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.522117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07341-8134-4115-8eca-4cbb5c494af3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.582201 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2f1f5-eef2-4fcc-93aa-b2e07d5a89bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.582911 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2f1f5-eef2-4fcc-93aa-b2e07d5a89bb admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.583230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2f1f5-eef2-4fcc-93aa-b2e07d5a89bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.583507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2f1f5-eef2-4fcc-93aa-b2e07d5a89bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.584263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2f1f5-eef2-4fcc-93aa-b2e07d5a89bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.585918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2f1f5-eef2-4fcc-93aa-b2e07d5a89bb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.599751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1315/2652] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:15.600920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.612736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0966-4626-4375-91a4-471ca265f53c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.619366 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.620384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.620784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.621254 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] PATH_INFO: `/v3/projects/1bf15a3937d64c30b878881ead1fdfe8/users/bba5b69e615046d2afb8e6c01424d5a1/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.623619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf15a3937d64c30b878881ead1fdfe8, user_id=bba5b69e615046d2afb8e6c01424d5a1, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.627627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.642338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1338/2653] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:15 2022] PUT /identity/v3/projects/1bf15a3937d64c30b878881ead1fdfe8/users/bba5b69e615046d2afb8e6c01424d5a1/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:15.652925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f4ad-7c7e-451c-8264-af6e97bbd06f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.653212 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f4ad-7c7e-451c-8264-af6e97bbd06f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.653486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f4ad-7c7e-451c-8264-af6e97bbd06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.681109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a577f4ad-7c7e-451c-8264-af6e97bbd06f None None] MFA Rules not processed for user `bba5b69e615046d2afb8e6c01424d5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:15.682366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a577f4ad-7c7e-451c-8264-af6e97bbd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:15.753909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1316/2654] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:15.767844 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.769624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:15.776153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.776629 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.776920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.797591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] MFA Rules not processed for user `8619dd8583734dfcb6d1eec3f1075b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:15.799158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:15.847237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971cc5-5dfc-4333-a9e6-6ac2b6152f57 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.851015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.851666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.851949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.852230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.856409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1317/2655] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:15.861428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:15.861428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:15.865898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.867658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:15.878289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1339/2656] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:15 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:15.931213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c0f90-e16d-4a2d-916b-ecfc994b9ba1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:15.935964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:15.936929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:15.937442 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:15.937822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] PATH_INFO: `/v3/projects/b02d70e27088485cbde6aa95dee38b2b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:15.939055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02d70e27088485cbde6aa95dee38b2b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:15.940964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.004153 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.005561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:16.017283 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3672-078d-4a64-8b66-badd482a168d service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.021165 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.021811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.022095 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.022375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.024376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:16.041907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02d70e27088485cbde6aa95dee38b2b', 'request_id': 'req-c38df748-bf87-4215-8c15-e14cf3c85992'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:16.087745 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.089194 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd5d98-943b-4d39-9a5c-039ff8162edf service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.099974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1340/2657] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:16.112274 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02d70e27088485cbde6aa95dee38b2b', 'request_id': 'req-c38df748-bf87-4215-8c15-e14cf3c85992'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:16.119008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02d70e27088485cbde6aa95dee38b2b', 'request_id': 'req-c38df748-bf87-4215-8c15-e14cf3c85992'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:16.132855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] The token cache is being invalidate because project b02d70e27088485cbde6aa95dee38b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:16.133151 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:16.133871 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c38df748-bf87-4215-8c15-e14cf3c85992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:16.136150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1318/2658] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:15 2022] DELETE /identity/v3/projects/b02d70e27088485cbde6aa95dee38b2b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:16.142903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.143237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.143573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.165014 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:16.166257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:16.247156 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1341/2659] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:16.252744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.253034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.253434 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.273694 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:16.274932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:16.284547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1319/2660] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:16.295417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.306285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec918a-733a-44e9-8c45-e0ae5fd15b5b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.311273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.312603 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.312953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.313361 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.314179 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:16.314552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.316271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.328784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1342/2661] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:27:16.333102 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.343017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196265-19a7-455c-a5ca-609aadec1efe None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.348757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.349723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.350081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.350360 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.351191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.353361 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.533105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1320/2662] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:16 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:16.537681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.548350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38706d-e05c-4e19-bf5a-77c57f685ef6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.602767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.603462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.603749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.604025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.604713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.606645 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.696090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1343/2663] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:16 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:16.703117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.713645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7780d-4c64-48a2-98c2-b5ed9f67d741 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.719137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.720041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.720041 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.720460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.721081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.722716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.734189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1321/2664] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:16.738222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.749313 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a11a1-5ccd-4808-bd49-61425c91de79 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.753996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ccb2a-2334-41ad-9a20-db6a8d669d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.757443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ccb2a-2334-41ad-9a20-db6a8d669d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.757443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ccb2a-2334-41ad-9a20-db6a8d669d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.757443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ccb2a-2334-41ad-9a20-db6a8d669d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.757443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ccb2a-2334-41ad-9a20-db6a8d669d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.757808 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ccb2a-2334-41ad-9a20-db6a8d669d8d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.767789 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1344/2665] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:16.772139 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:16.782716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9b433-afc7-4a1c-bec1-bf09eb6bcf55 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:16.787706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:16.788583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.788897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.789176 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] PATH_INFO: `/v3/projects/847200452c32481ab70b3e63dfbff046/users/7582c1ece8fa407496e4f90726d3e199/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.804967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=847200452c32481ab70b3e63dfbff046, user_id=7582c1ece8fa407496e4f90726d3e199, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:16.807504 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:16.920455 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1322/2666] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:16 2022] PUT /identity/v3/projects/847200452c32481ab70b3e63dfbff046/users/7582c1ece8fa407496e4f90726d3e199/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:16.933238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:16.933553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:16.933829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:16.962253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] MFA Rules not processed for user `7582c1ece8fa407496e4f90726d3e199`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:16.963485 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:17.029562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1345/2667] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:17.035111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.095388 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9f013-61d2-4b94-838f-63840d4786ba admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.100163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.100807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.101088 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.101364 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.102061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.104008 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:17.182130 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1323/2668] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:17 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:17.186301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.197839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f0fa-e83d-4877-a6d8-07e6636af8ba None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.255697 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.256399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.256676 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.256958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.257662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.259638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:17.346203 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1346/2669] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:17 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:17.350259 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.361210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75eb0-6455-4ab4-8910-a8c9b9656c5e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.365837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.367516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.367516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.367516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.368141 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.369815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:17.382078 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1324/2670] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:17.386231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.397119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667e2fa-57bd-4db3-aef5-24d9f31cf755 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.401900 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f7ed8-2e51-4609-aaa1-de733aaf7113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.402551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f7ed8-2e51-4609-aaa1-de733aaf7113 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.402837 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f7ed8-2e51-4609-aaa1-de733aaf7113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.403154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f7ed8-2e51-4609-aaa1-de733aaf7113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.403876 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f7ed8-2e51-4609-aaa1-de733aaf7113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.405621 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f7ed8-2e51-4609-aaa1-de733aaf7113 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:17.415909 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1347/2671] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:17.420244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.430084 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff4ae-7f8b-4916-a9a8-f14996486078 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.434769 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.435671 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.435950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.436271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] PATH_INFO: `/v3/projects/3d0e1032866d47728a43cf4c75422827/users/294ca6e7845a458e8c9e194e640196a8/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.451614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0e1032866d47728a43cf4c75422827, user_id=294ca6e7845a458e8c9e194e640196a8, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.455155 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:17.570589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1325/2672] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:17 2022] PUT /identity/v3/projects/3d0e1032866d47728a43cf4c75422827/users/294ca6e7845a458e8c9e194e640196a8/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:17.583144 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.583434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.583706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.610600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] MFA Rules not processed for user `294ca6e7845a458e8c9e194e640196a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:17.611843 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:17.674381 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1348/2673] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:17.679133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.744460 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644bb74-45b7-401d-9f07-c40e147676c6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.750365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.751123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.751409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.751680 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.752379 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.754273 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:17.837570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1326/2674] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:17 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:17.841557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:17.852552 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf6945-103d-4486-9b27-e33710b1b50c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:17.907686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:17.908261 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:17.908543 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:17.908819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:17.909538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:17.911487 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.024086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1349/2675] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:17 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:18.028089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:18.038880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a4fd-95c2-4377-9a75-94e75bcb8b3f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:18.043496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:18.044143 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.044421 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.044746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.045450 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:18.047788 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.058023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1327/2676] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:18.062768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:18.073440 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03305f74-6810-42cb-b58d-7319cb50d378 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:18.078467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:18.079289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.079580 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.079855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] PATH_INFO: `/v3/projects/e58d0a2a37ec4778819e9bec9883e980/users/da673de78505422996ab0dfd6ea50091/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.096521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58d0a2a37ec4778819e9bec9883e980, user_id=da673de78505422996ab0dfd6ea50091, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:18.099237 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.183681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1350/2677] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:18 2022] PUT /identity/v3/projects/e58d0a2a37ec4778819e9bec9883e980/users/da673de78505422996ab0dfd6ea50091/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:18.187799 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:18.198815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89565aa-38e3-415e-83f7-b4c34e049778 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:18.264286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9780c-865c-40aa-a9f7-d15c7efe8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:18.264957 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9780c-865c-40aa-a9f7-d15c7efe8551 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.265410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9780c-865c-40aa-a9f7-d15c7efe8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.265691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9780c-865c-40aa-a9f7-d15c7efe8551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.266424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9780c-865c-40aa-a9f7-d15c7efe8551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:18.268032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9780c-865c-40aa-a9f7-d15c7efe8551 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.281752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1328/2678] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:18.283233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:18.293443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b343-68a3-42e9-bb30-1065ea9ba872 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:18.298861 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:18.299759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.300043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.300295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] PATH_INFO: `/v3/projects/e58d0a2a37ec4778819e9bec9883e980/users/da673de78505422996ab0dfd6ea50091/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.302238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58d0a2a37ec4778819e9bec9883e980, user_id=da673de78505422996ab0dfd6ea50091, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:18.304994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.316879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1351/2679] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:18 2022] PUT /identity/v3/projects/e58d0a2a37ec4778819e9bec9883e980/users/da673de78505422996ab0dfd6ea50091/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:18.327829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.328124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.328410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.356735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] MFA Rules not processed for user `da673de78505422996ab0dfd6ea50091`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:18.357939 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:18.427523 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1329/2680] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:18.439238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:18.440910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:18.499055 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b53050-956f-4730-8540-b335206289b3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:18.502774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:18.503453 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.503740 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.504019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.513089 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:18.514557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.524871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1352/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:18.681884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:18.692243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f84d-1984-4e77-b844-a9d595f02bae None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:18.695807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f105f01-62ba-48e1-a347-8e447a529259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:18.696570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105f01-62ba-48e1-a347-8e447a529259 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:18.696852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105f01-62ba-48e1-a347-8e447a529259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:18.697133 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105f01-62ba-48e1-a347-8e447a529259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:18.754796 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f105f01-62ba-48e1-a347-8e447a529259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:18.756277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f105f01-62ba-48e1-a347-8e447a529259 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:18.765884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1330/2682] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:21.597791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:21.599333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:21.666300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db1e9-1f1c-4500-a846-549d08b60226 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:21.670918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:21.672820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:21.672820 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:21.673181 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] PATH_INFO: `/v3/users/afece24e3cea4d11b46219fea43797e7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:21.674234 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afece24e3cea4d11b46219fea43797e7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:21.676200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:21.897052 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afece24e3cea4d11b46219fea43797e7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:21.909304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afece24e3cea4d11b46219fea43797e7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:21.910011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afece24e3cea4d11b46219fea43797e7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:21.910706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afece24e3cea4d11b46219fea43797e7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:21.980571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afece24e3cea4d11b46219fea43797e7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:21.994934 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1353/2683] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:21 2022] DELETE /identity/v3/users/afece24e3cea4d11b46219fea43797e7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:21.999562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:22.000118 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:22.000374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:22.017075 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:22.018292 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:22.079844 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1331/2684] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:22.090422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:22.091821 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:22.153737 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553480e-5f1a-443a-b016-09bdaccab091 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:22.158615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:22.160346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:22.160346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:22.160346 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:22.169791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:22.171299 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:22.182474 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1354/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:22.634324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:22.635838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:22.648569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794c68-3cfc-4233-a9ee-858139aa8283 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:22.653196 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:22.654058 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:22.654344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:22.654618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] PATH_INFO: `/v3/projects/849349c60f6a48ee8e7e38b47c443e6e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:22.655880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849349c60f6a48ee8e7e38b47c443e6e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:22.658167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:22.769734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849349c60f6a48ee8e7e38b47c443e6e', 'request_id': 'req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:22.843230 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849349c60f6a48ee8e7e38b47c443e6e', 'request_id': 'req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:22.849954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849349c60f6a48ee8e7e38b47c443e6e', 'request_id': 'req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:22.861897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] The token cache is being invalidate because project 849349c60f6a48ee8e7e38b47c443e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:22.862190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:22.862853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:22.864590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1332/2686] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:22 2022] DELETE /identity/v3/projects/849349c60f6a48ee8e7e38b47c443e6e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:22.868550 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:22.880405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816ef7a-a685-451e-8651-ac21a46491e9 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:22.941098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:22.941973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:22.942260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:22.942544 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] PATH_INFO: `/v3/users/bba5b69e615046d2afb8e6c01424d5a1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:22.943767 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba5b69e615046d2afb8e6c01424d5a1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:22.945751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:23.031720 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:23.033222 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:23.048948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f3c0e-7bbf-447b-b0dc-e5f6d0a49aa6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:23.053854 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:23.054721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:23.055031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:23.055317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] PATH_INFO: `/v3/users/7582c1ece8fa407496e4f90726d3e199` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:23.056549 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7582c1ece8fa407496e4f90726d3e199)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:23.058521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:23.112201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba5b69e615046d2afb8e6c01424d5a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.123736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba5b69e615046d2afb8e6c01424d5a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.128839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba5b69e615046d2afb8e6c01424d5a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.128839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba5b69e615046d2afb8e6c01424d5a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.198232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-95614e52-473f-436c-83ae-079a3128a15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba5b69e615046d2afb8e6c01424d5a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.213674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1355/2687] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:22 2022] DELETE /identity/v3/users/bba5b69e615046d2afb8e6c01424d5a1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:23.338407 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7582c1ece8fa407496e4f90726d3e199'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.339189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7582c1ece8fa407496e4f90726d3e199'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.352017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7582c1ece8fa407496e4f90726d3e199'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.352723 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7582c1ece8fa407496e4f90726d3e199'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.479267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7582c1ece8fa407496e4f90726d3e199'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.492896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1333/2688] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:23 2022] DELETE /identity/v3/users/7582c1ece8fa407496e4f90726d3e199 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:23.497316 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:23.497611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:23.497894 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:23.516327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:23.517628 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:23.579918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1356/2689] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:23.589636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:23.591097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:23.650942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d626-08b0-4b29-875a-21af0b00e6fd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:23.654760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c1c9-97c4-4bac-96d7-4e43acb90a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:23.655439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c1c9-97c4-4bac-96d7-4e43acb90a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:23.655728 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c1c9-97c4-4bac-96d7-4e43acb90a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:23.656007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c1c9-97c4-4bac-96d7-4e43acb90a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:23.665677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c1c9-97c4-4bac-96d7-4e43acb90a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:23.667156 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c1c9-97c4-4bac-96d7-4e43acb90a60 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:23.677493 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1334/2690] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:23.749178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:23.751463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:23.763275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b2f7f-e967-4234-a384-a413d06244e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:23.768039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:23.769532 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:23.769818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:23.770093 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] PATH_INFO: `/v3/projects/1bf15a3937d64c30b878881ead1fdfe8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:23.771336 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf15a3937d64c30b878881ead1fdfe8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:23.773253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:23.898854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf15a3937d64c30b878881ead1fdfe8', 'request_id': 'req-008b36bf-9087-488f-b63e-bb203fc0609c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.955042 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf15a3937d64c30b878881ead1fdfe8', 'request_id': 'req-008b36bf-9087-488f-b63e-bb203fc0609c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.962502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf15a3937d64c30b878881ead1fdfe8', 'request_id': 'req-008b36bf-9087-488f-b63e-bb203fc0609c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.975435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] The token cache is being invalidate because project 1bf15a3937d64c30b878881ead1fdfe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:23.975658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.976337 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-008b36bf-9087-488f-b63e-bb203fc0609c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:23.978168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1357/2691] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:23 2022] DELETE /identity/v3/projects/1bf15a3937d64c30b878881ead1fdfe8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:23.983183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:23.983498 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:23.983743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.003172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:24.004398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.071471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1335/2692] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:24.079712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.080490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.080490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.099463 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:24.100674 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.108906 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1358/2693] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:24.114505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.128134 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.128346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17cf32-1369-4d48-8a55-e1cb3d3d96d7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.129899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.135589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.136930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.137149 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.137474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.138374 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:24.138690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.141963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.145458 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158c1ec-20a9-499e-8fa1-8d3bd4135742 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.150783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.152050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.152334 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.152766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] PATH_INFO: `/v3/projects/847200452c32481ab70b3e63dfbff046` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.154271 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847200452c32481ab70b3e63dfbff046)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.156255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.159557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1336/2694] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:27:24.164056 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.175335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa029a-338f-4be2-bdb1-5d450950b176 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.180275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.180936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.181220 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.181507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.182324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.184263 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.281833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847200452c32481ab70b3e63dfbff046', 'request_id': 'req-498ba35a-e73b-483f-8658-a2dda2e4a869'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.297045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1337/2695] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:24 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:24.298641 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.363994 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9d89-562b-421f-948f-21583891e66b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.368958 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.369624 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.369925 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.370184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.370887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.372819 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.377899 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847200452c32481ab70b3e63dfbff046', 'request_id': 'req-498ba35a-e73b-483f-8658-a2dda2e4a869'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.384591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847200452c32481ab70b3e63dfbff046', 'request_id': 'req-498ba35a-e73b-483f-8658-a2dda2e4a869'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.396801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] The token cache is being invalidate because project 847200452c32481ab70b3e63dfbff046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:24.397091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.397801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.399427 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1359/2696] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:24 2022] DELETE /identity/v3/projects/847200452c32481ab70b3e63dfbff046 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:24.403418 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.404824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.471421 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba35a-e73b-483f-8658-a2dda2e4a869 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.475920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1338/2697] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:24 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:24.476747 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.477693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.477983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.478288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] PATH_INFO: `/v3/users/294ca6e7845a458e8c9e194e640196a8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.479553 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=294ca6e7845a458e8c9e194e640196a8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.480004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.481530 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.483127 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.497600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0976b40-c656-41ef-9d5d-bf976f004f0c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.506012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.506801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.507147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.507432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.519199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.519199 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.523029 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1339/2698] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:24.526308 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.545556 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cce54a-3728-4e8d-a976-25f216e3393f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.551952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.553573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.553573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.553573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.553982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.555497 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.570409 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1340/2699] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:24.574640 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.590271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286444-25d4-4e6e-9e95-ff58f87f26da admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.595987 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.596891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.597184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.597469 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] PATH_INFO: `/v3/projects/4630b26324354b97863df6a9be4b16da/users/21cb2948a8d948a8b4cf65b4bc5b01f4/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.613740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4630b26324354b97863df6a9be4b16da, user_id=21cb2948a8d948a8b4cf65b4bc5b01f4, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.616554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.707576 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1341/2700] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:24 2022] PUT /identity/v3/projects/4630b26324354b97863df6a9be4b16da/users/21cb2948a8d948a8b4cf65b4bc5b01f4/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:24.708414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.711326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.737601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294ca6e7845a458e8c9e194e640196a8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.750456 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294ca6e7845a458e8c9e194e640196a8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.751600 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294ca6e7845a458e8c9e194e640196a8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.752216 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294ca6e7845a458e8c9e194e640196a8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.771961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21283-7b91-463a-a204-6553acc1e6c6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.775725 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.779727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.779727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.779727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.779727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.789752 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.791286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a033-fd05-46e0-8ac5-8b2334c515d3 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:24.800482 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1342/2701] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:24.803445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.803445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.803445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.820915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294ca6e7845a458e8c9e194e640196a8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:24.831099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] MFA Rules not processed for user `21cb2948a8d948a8b4cf65b4bc5b01f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:24.832300 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.835260 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1360/2702] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:24 2022] DELETE /identity/v3/users/294ca6e7845a458e8c9e194e640196a8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:24.907304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1343/2703] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:24.912579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:24.914017 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:24.983395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ee576-13b3-43ea-9690-463ebc91d52b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:24.989285 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:24.989989 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:24.990302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:24.990656 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:24.991402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:24.993518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.108623 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1361/2704] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:24 2022] POST /identity/v3/projects => generated 391 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:25.114239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.128378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820877c-516e-4dbd-89a6-9624d1b10b7d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.192672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.193356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.193636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.193912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.194636 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.196565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.271802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.273716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:25.289259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4b25-b6a9-42c4-a5cf-18e45a84907d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.294466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.295367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.300832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.300832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] PATH_INFO: `/v3/projects/3d0e1032866d47728a43cf4c75422827` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.300832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0e1032866d47728a43cf4c75422827)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.300832 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.301652 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1344/2705] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:25 2022] POST /identity/v3/users => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:25.303695 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.314073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a671bb1-53ea-4359-bcb5-ebaf63b2f911 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.318808 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.319524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.319818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.320098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.320838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.322420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.340006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1345/2706] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:25.344882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.354762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29061a-e6e9-44e3-adca-4ac950f4d285 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.360536 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.361433 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.361756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.362044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] PATH_INFO: `/v3/projects/ff1beed9930747c4b22e3898e341f582/users/06f9730c410449da8516ff27067c8b27/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.377783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1beed9930747c4b22e3898e341f582, user_id=06f9730c410449da8516ff27067c8b27, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.380567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.547207 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1346/2707] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:25 2022] PUT /identity/v3/projects/ff1beed9930747c4b22e3898e341f582/users/06f9730c410449da8516ff27067c8b27/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:25.551281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.560596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0e1032866d47728a43cf4c75422827', 'request_id': 'req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:25.665964 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a03954-b7e4-4358-9560-203c8a30603c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.666417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0e1032866d47728a43cf4c75422827', 'request_id': 'req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:25.673410 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0e1032866d47728a43cf4c75422827', 'request_id': 'req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:25.686376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] The token cache is being invalidate because project 3d0e1032866d47728a43cf4c75422827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:25.686662 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:25.688137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:25.689730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1362/2708] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:25 2022] DELETE /identity/v3/projects/3d0e1032866d47728a43cf4c75422827 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:25.693686 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.695226 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:25.736243 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.737159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.737448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.737727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.738462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.740473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.759622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1347/2709] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:25.762661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.764505 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:25.777408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cccc1-4926-46c5-b54b-fb4846fb7b9c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.782954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b5b7-99ad-4e46-b674-9e6cec3db616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.783948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b5b7-99ad-4e46-b674-9e6cec3db616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.784229 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b5b7-99ad-4e46-b674-9e6cec3db616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.784508 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b5b7-99ad-4e46-b674-9e6cec3db616 admin admin] PATH_INFO: `/v3/projects/ff1beed9930747c4b22e3898e341f582/users/06f9730c410449da8516ff27067c8b27/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.786520 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986b5b7-99ad-4e46-b674-9e6cec3db616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1beed9930747c4b22e3898e341f582, user_id=06f9730c410449da8516ff27067c8b27, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.789746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986b5b7-99ad-4e46-b674-9e6cec3db616 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.798779 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428791d-39e5-4595-acc3-3c1b8fe5ef6a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:25.808920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1348/2710] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:25 2022] PUT /identity/v3/projects/ff1beed9930747c4b22e3898e341f582/users/06f9730c410449da8516ff27067c8b27/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:25.820910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.821200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.821480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.887372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:25.888430 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:25.888905 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] MFA Rules not processed for user `06f9730c410449da8516ff27067c8b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:25.889006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:25.889204 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] PATH_INFO: `/v3/users/da673de78505422996ab0dfd6ea50091` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:25.890190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:25.890446 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da673de78505422996ab0dfd6ea50091)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:25.892579 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:25.980276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1349/2711] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:25.991366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:25.993239 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:26.053395 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48adf59-6795-4956-a715-1afd0e52d29e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:26.057967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:26.058612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:26.058896 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:26.059335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:26.063247 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da673de78505422996ab0dfd6ea50091'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.071432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:26.072875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:26.077508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da673de78505422996ab0dfd6ea50091'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.078973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da673de78505422996ab0dfd6ea50091'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.079665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da673de78505422996ab0dfd6ea50091'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.084108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1350/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:26.133330 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:26.134082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:26.147422 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb2e6-b523-4a7e-aa63-3eb1976387f7 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:26.151949 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da673de78505422996ab0dfd6ea50091'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.155760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:26.155760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:26.155760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:26.155760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:26.156722 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:26.169962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1363/2713] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:25 2022] DELETE /identity/v3/users/da673de78505422996ab0dfd6ea50091 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:26.231894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:26.233354 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128056f-9604-4452-b998-6a2fad488dbc service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:26.242743 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1351/2714] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:26.617046 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:26.620214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:26.697190 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f929d6-46dc-42c0-ac7b-56dec31b5631 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:26.702167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:26.703088 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:26.703376 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:26.703652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] PATH_INFO: `/v3/projects/e58d0a2a37ec4778819e9bec9883e980` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:26.704847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58d0a2a37ec4778819e9bec9883e980)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:26.706770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:26.857599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58d0a2a37ec4778819e9bec9883e980', 'request_id': 'req-c27c3b3f-0f17-4885-9a14-71bfa83a8898'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.943379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58d0a2a37ec4778819e9bec9883e980', 'request_id': 'req-c27c3b3f-0f17-4885-9a14-71bfa83a8898'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.951664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58d0a2a37ec4778819e9bec9883e980', 'request_id': 'req-c27c3b3f-0f17-4885-9a14-71bfa83a8898'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.962211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] The token cache is being invalidate because project e58d0a2a37ec4778819e9bec9883e980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:26.962518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.963209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c27c3b3f-0f17-4885-9a14-71bfa83a8898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:26.965001 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1364/2715] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:26 2022] DELETE /identity/v3/projects/e58d0a2a37ec4778819e9bec9883e980 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:26.971707 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:26.972085 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:26.972439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:26.991701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:26.992908 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:27.058249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1352/2716] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:27.067746 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.068323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.068323 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.087451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:27.088671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:27.101977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1365/2717] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:27.103335 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.115161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3697df7-9c1b-4325-beae-fc7af6a25461 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.121304 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.122055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.122519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.122880 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.123826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:27.124519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.126323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.139496 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1353/2718] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:27:27.148048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.158502 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6bc8c-f04d-443c-a58d-e989079e87cb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.163685 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.164344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.164632 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.164908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.165597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.167551 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.282481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1366/2719] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:27 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:27.286600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.297463 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9981f-2a7b-4f1a-bdb3-efe32f144e02 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.353882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.354541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.354822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.355126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.355803 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.357699 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.452384 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1354/2720] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:27 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:27.457422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.467859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d540-f6d4-487f-90f4-fe6ec7f2612c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.473199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.473929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.474217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.474497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.475265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.476997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.488408 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1367/2721] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:27.493901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.504161 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99870-3fe2-4b53-9cac-3f0cb5f7c928 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.510296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f374d3-ce6d-4145-80db-7b1f8c4aeec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.510971 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f374d3-ce6d-4145-80db-7b1f8c4aeec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.511295 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f374d3-ce6d-4145-80db-7b1f8c4aeec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.511575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f374d3-ce6d-4145-80db-7b1f8c4aeec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.512307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f374d3-ce6d-4145-80db-7b1f8c4aeec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.513946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f374d3-ce6d-4145-80db-7b1f8c4aeec3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.526475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1355/2722] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:27.533236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.543422 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bcc3-9751-49a6-b6c3-b1aafb711796 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.548442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.549311 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.549593 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.549869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] PATH_INFO: `/v3/projects/309b01b9d92e4ede9ae5840b7b6dc843/users/0f6129531b1a448b9d7eae86be2a8c00/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.564516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309b01b9d92e4ede9ae5840b7b6dc843, user_id=0f6129531b1a448b9d7eae86be2a8c00, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.567235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.641862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1368/2723] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:27 2022] PUT /identity/v3/projects/309b01b9d92e4ede9ae5840b7b6dc843/users/0f6129531b1a448b9d7eae86be2a8c00/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:27.647280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db84f1-bf90-49ea-ba93-a6941f60e841 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.647622 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db84f1-bf90-49ea-ba93-a6941f60e841 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.647948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db84f1-bf90-49ea-ba93-a6941f60e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.667117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-00db84f1-bf90-49ea-ba93-a6941f60e841 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:27.668352 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-00db84f1-bf90-49ea-ba93-a6941f60e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:27.727094 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1356/2724] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:27.736561 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:27.738225 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:27.795098 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d2d5c-36cf-4170-b589-e65feaee5f29 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:27.799339 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:27.799989 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:27.800273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:27.800549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:27.809573 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:27.811038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:27.821375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1369/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:29.100739 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:29.101282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:29.101583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:29.131474 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] MFA Rules not processed for user `0f6129531b1a448b9d7eae86be2a8c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:29.133021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:29.218815 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1357/2726] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:29.230264 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:29.232800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:29.290924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b1b0d-f9b4-47c2-b51d-8da23a35243e service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:29.294442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c526ff6-72f2-40d5-a9c3-c6cd3eabff77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:29.295120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526ff6-72f2-40d5-a9c3-c6cd3eabff77 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:29.295404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526ff6-72f2-40d5-a9c3-c6cd3eabff77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:29.295677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526ff6-72f2-40d5-a9c3-c6cd3eabff77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:29.304653 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526ff6-72f2-40d5-a9c3-c6cd3eabff77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:29.306080 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526ff6-72f2-40d5-a9c3-c6cd3eabff77 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:29.315079 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1370/2727] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:31.043332 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:31.044793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:31.058968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aacd33-51f2-4bf3-9a29-83dfeea5fc85 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:31.063524 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:31.064453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:31.064738 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:31.065019 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] PATH_INFO: `/v3/users/21cb2948a8d948a8b4cf65b4bc5b01f4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:31.066213 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cb2948a8d948a8b4cf65b4bc5b01f4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:31.068219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:31.122605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:31.123252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:31.123252 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:31.141443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] MFA Rules not processed for user `0f6129531b1a448b9d7eae86be2a8c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:31.146809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:31.150429 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1371/2728] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:31.260467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cb2948a8d948a8b4cf65b4bc5b01f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:31.261110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cb2948a8d948a8b4cf65b4bc5b01f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:31.274147 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cb2948a8d948a8b4cf65b4bc5b01f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:31.274935 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cb2948a8d948a8b4cf65b4bc5b01f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:31.374343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-530e4fe0-fae6-4961-a071-451808705eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cb2948a8d948a8b4cf65b4bc5b01f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:31.382230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:31.387532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1358/2729] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:31 2022] DELETE /identity/v3/users/21cb2948a8d948a8b4cf65b4bc5b01f4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:31.391751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:31.392651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:31.392881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:31.394384 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fe088-f783-4e75-a61d-57841b9c5f51 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:31.411182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:31.412628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:31.448647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:31.449302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:31.449592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:31.450068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:31.451915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:31.462338 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:31.463813 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:31.471988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1372/2730] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:27:31.475249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1359/2731] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:31.484057 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:31.485511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:31.496060 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f67fe-4053-4ca0-b6d1-f503b59008b4 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:31.499768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:31.500404 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:31.500687 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:31.500967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:31.510904 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:31.513846 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:31.523161 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1373/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:31.991254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:31.992650 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:32.004537 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6c75b-74f8-4131-b82f-dd5610376ceb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:32.009189 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:32.010050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:32.010342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:32.011291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] PATH_INFO: `/v3/projects/4630b26324354b97863df6a9be4b16da` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:32.012089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4630b26324354b97863df6a9be4b16da)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:32.014031 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:32.132242 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4630b26324354b97863df6a9be4b16da', 'request_id': 'req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.194573 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4630b26324354b97863df6a9be4b16da', 'request_id': 'req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.200634 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4630b26324354b97863df6a9be4b16da', 'request_id': 'req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.212195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] The token cache is being invalidate because project 4630b26324354b97863df6a9be4b16da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:32.212481 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.213159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.214713 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1360/2733] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:31 2022] DELETE /identity/v3/projects/4630b26324354b97863df6a9be4b16da => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:32.218699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:32.232787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d09ea5-5696-44cc-92c2-fae745c9e8d2 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:32.292068 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:32.292944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:32.293231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:32.293508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] PATH_INFO: `/v3/users/06f9730c410449da8516ff27067c8b27` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:32.294712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f9730c410449da8516ff27067c8b27)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:32.296733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:32.734596 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f9730c410449da8516ff27067c8b27'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.746373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f9730c410449da8516ff27067c8b27'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.747121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f9730c410449da8516ff27067c8b27'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.747750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f9730c410449da8516ff27067c8b27'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.828986 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f9730c410449da8516ff27067c8b27'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:32.843287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1374/2734] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:32 2022] DELETE /identity/v3/users/06f9730c410449da8516ff27067c8b27 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:27:32.951952 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:32.953317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:33.023936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2bc21-f967-4fcd-82a0-aa5d59ea4648 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:33.086970 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:33.087656 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.087937 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.088210 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.090055 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:33.101912 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:33.104288 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5809e19-35df-4283-9c63-2ff478721434 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:33.116476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1361/2735] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:33.342462 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:33.344085 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:33.410444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fece0b-dff5-4282-b73f-c8a7760da75e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:33.415324 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:33.416170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.416459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.416742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] PATH_INFO: `/v3/projects/ff1beed9930747c4b22e3898e341f582` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.417932 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1beed9930747c4b22e3898e341f582)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:33.419883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:33.540303 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1beed9930747c4b22e3898e341f582', 'request_id': 'req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:33.620611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1beed9930747c4b22e3898e341f582', 'request_id': 'req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:33.626815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1beed9930747c4b22e3898e341f582', 'request_id': 'req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:33.638333 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] The token cache is being invalidate because project ff1beed9930747c4b22e3898e341f582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:33.638622 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:33.639295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-57d66c34-8acf-4a2d-ba7e-0c379f15ce5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:33.640871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1375/2736] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:33 2022] DELETE /identity/v3/projects/ff1beed9930747c4b22e3898e341f582 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:33.647108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.647654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.647774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.667218 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:33.668431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:33.726933 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1362/2737] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:33.734787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.735119 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.735407 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.754677 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:33.755925 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:33.764000 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1376/2738] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:33.768899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:33.778681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7573c-d6f9-4b92-9973-9dc1021dc651 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:33.783435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:33.784081 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.784358 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.784632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.785355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:33.785654 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:33.787522 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:33.799477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1363/2739] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:27:33.803886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:33.813172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd7ae-deef-4116-8ed0-838bd26efe42 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:33.818540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:33.819263 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.819548 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.819827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.820516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:33.822466 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:33.916666 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1377/2740] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:33 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:33.920544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:33.931037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2407f-a110-454f-a108-a2ed89e8976f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:33.987593 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:33.988270 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:33.988558 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:33.988840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:33.989541 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:33.991501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.072109 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1364/2741] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:33 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:34.076236 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.086520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ab935-bb00-4b80-b4f9-1284088d39e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.091146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.091802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.092086 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.092364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.093082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.094665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.104898 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1378/2742] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:34.108845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.120146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c87c7-eecb-4b9c-be2f-759baf9014cc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.125044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11a14-a423-4449-aec1-45644989281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.125700 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11a14-a423-4449-aec1-45644989281a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.125983 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11a14-a423-4449-aec1-45644989281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.127070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11a14-a423-4449-aec1-45644989281a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.127631 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11a14-a423-4449-aec1-45644989281a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.129214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11a14-a423-4449-aec1-45644989281a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.139021 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1365/2743] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:34.143250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.153186 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66256b-2b13-4996-b341-82461d9183f5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.157929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.158835 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.159167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.159439 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] PATH_INFO: `/v3/projects/9dcc70ef418c4ccfb45e324968acf845/users/fb55f88793ab451190f95b49541671a4/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.174187 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcc70ef418c4ccfb45e324968acf845, user_id=fb55f88793ab451190f95b49541671a4, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.176823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.249146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1379/2744] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:34 2022] PUT /identity/v3/projects/9dcc70ef418c4ccfb45e324968acf845/users/fb55f88793ab451190f95b49541671a4/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:34.260146 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.260439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.260718 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.288682 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] MFA Rules not processed for user `fb55f88793ab451190f95b49541671a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:34.290007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:34.364074 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1366/2745] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:34.365363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.433497 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4427-95ab-4330-b06e-811f9c01ab2e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.438172 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.439558 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.439860 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.440139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.440864 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.442840 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.585250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1380/2746] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:34 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:34.589289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.625098 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860dae-4197-4a98-8e9d-0a36c5c81561 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.686252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.686890 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.687123 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.687398 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.688092 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.690539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.775253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1367/2747] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:34 2022] POST /identity/v3/users => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:34.779121 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.813176 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5a2ac-41f9-447b-bb5c-91a178d45725 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.818815 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.819507 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.819795 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.820076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.820793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.822399 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.833266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1381/2748] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:27:34.837483 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.847767 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bb3bc-f02a-4ad7-bee8-46dc9b833f64 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:34.852291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:34.853163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:34.853449 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:34.853730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] PATH_INFO: `/v3/projects/30a1d141f6af4fdeb4726bb1c88d651c/users/56169e89fd724e93a23a027e597115e1/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:34.869011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a1d141f6af4fdeb4726bb1c88d651c, user_id=56169e89fd724e93a23a027e597115e1, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:34.871730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:34.947064 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1368/2749] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:34 2022] PUT /identity/v3/projects/30a1d141f6af4fdeb4726bb1c88d651c/users/56169e89fd724e93a23a027e597115e1/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:34.950924 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:34.961587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa44cb-da93-4845-ae24-ac7632ad1391 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:35.018716 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9796b6-5e08-445e-bbbb-d07cfe2abb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:35.019444 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9796b6-5e08-445e-bbbb-d07cfe2abb58 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.019728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9796b6-5e08-445e-bbbb-d07cfe2abb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.020008 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9796b6-5e08-445e-bbbb-d07cfe2abb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:35.020725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9796b6-5e08-445e-bbbb-d07cfe2abb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:35.022350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9796b6-5e08-445e-bbbb-d07cfe2abb58 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:35.031977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1382/2750] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:35.036521 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:35.047105 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba021e-ae40-4e56-913e-226cf73a5075 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:35.052990 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:35.053893 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.054275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.054465 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] PATH_INFO: `/v3/projects/30a1d141f6af4fdeb4726bb1c88d651c/users/56169e89fd724e93a23a027e597115e1/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:35.056467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a1d141f6af4fdeb4726bb1c88d651c, user_id=56169e89fd724e93a23a027e597115e1, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:35.059153 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:35.070082 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1369/2751] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:35 2022] PUT /identity/v3/projects/30a1d141f6af4fdeb4726bb1c88d651c/users/56169e89fd724e93a23a027e597115e1/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:35.081941 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.082231 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.082511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:35.108591 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] MFA Rules not processed for user `56169e89fd724e93a23a027e597115e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:35.109791 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:35.177199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1383/2752] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:35.194135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:35.196140 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:35.268969 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3c02-459a-492d-877b-8126381fcebc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:35.272628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30298ae-0a74-4966-a301-7ab735c36721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:35.273285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30298ae-0a74-4966-a301-7ab735c36721 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.273567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30298ae-0a74-4966-a301-7ab735c36721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.273846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30298ae-0a74-4966-a301-7ab735c36721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:35.283538 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30298ae-0a74-4966-a301-7ab735c36721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:35.284980 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30298ae-0a74-4966-a301-7ab735c36721 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:35.294562 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1370/2753] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:35.434202 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:35.501706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ab994-8388-43e1-9913-ff6d44ab0813 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:35.506521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:35.507435 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.507719 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.507996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] PATH_INFO: `/v3/users/fb55f88793ab451190f95b49541671a4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:35.509200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb55f88793ab451190f95b49541671a4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:35.511155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:35.719833 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb55f88793ab451190f95b49541671a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:35.732750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb55f88793ab451190f95b49541671a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:35.733478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb55f88793ab451190f95b49541671a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:35.734235 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb55f88793ab451190f95b49541671a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:35.820133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb55f88793ab451190f95b49541671a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:35.834350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1384/2754] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:35 2022] DELETE /identity/v3/users/fb55f88793ab451190f95b49541671a4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:35.839179 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.839647 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.839745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:35.857946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:35.859206 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:35.918600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1371/2755] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:35.928555 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:35.932546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:35.992879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91db6-864c-4acd-abe4-f31cd95dacad admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:35.996913 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:35.997598 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:35.997875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:35.998149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:36.009233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:36.010704 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:36.021367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1385/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:36.522846 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:36.524402 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:36.540620 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd47bb-eb9d-4a10-85ee-c559eea2f1bd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:36.545454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:36.546331 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:36.546610 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:36.546882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] PATH_INFO: `/v3/projects/9dcc70ef418c4ccfb45e324968acf845` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:36.548245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcc70ef418c4ccfb45e324968acf845)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:36.550180 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:36.658477 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcc70ef418c4ccfb45e324968acf845', 'request_id': 'req-a0e52a29-4624-4287-b18d-abdedeaaed1a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:36.745849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcc70ef418c4ccfb45e324968acf845', 'request_id': 'req-a0e52a29-4624-4287-b18d-abdedeaaed1a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:36.753473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcc70ef418c4ccfb45e324968acf845', 'request_id': 'req-a0e52a29-4624-4287-b18d-abdedeaaed1a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:36.765486 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] The token cache is being invalidate because project 9dcc70ef418c4ccfb45e324968acf845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:36.765696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:36.768013 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:36.769600 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1372/2757] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:36 2022] DELETE /identity/v3/projects/9dcc70ef418c4ccfb45e324968acf845 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:36.773540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:36.783112 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729044c-4fde-4ed6-8c22-ed527f58ff00 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:36.840248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:36.841106 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:36.841388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:36.841667 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] PATH_INFO: `/v3/users/56169e89fd724e93a23a027e597115e1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:36.842854 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56169e89fd724e93a23a027e597115e1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:36.845416 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:37.039979 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56169e89fd724e93a23a027e597115e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.052706 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56169e89fd724e93a23a027e597115e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.053395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56169e89fd724e93a23a027e597115e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.053994 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56169e89fd724e93a23a027e597115e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.125725 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6229e3d-6e40-48fe-913f-ad76f49f897d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56169e89fd724e93a23a027e597115e1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.138615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1386/2758] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:36 2022] DELETE /identity/v3/users/56169e89fd724e93a23a027e597115e1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:37.618185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:37.618185 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:37.629117 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52a29-4624-4287-b18d-abdedeaaed1a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:37.688282 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:37.689660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:37.689936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:37.690211 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] PATH_INFO: `/v3/projects/30a1d141f6af4fdeb4726bb1c88d651c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:37.691431 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a1d141f6af4fdeb4726bb1c88d651c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:37.693414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:37.826863 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a1d141f6af4fdeb4726bb1c88d651c', 'request_id': 'req-3b6d3552-b9a7-4517-a92d-35c04b8edee3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.888879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a1d141f6af4fdeb4726bb1c88d651c', 'request_id': 'req-3b6d3552-b9a7-4517-a92d-35c04b8edee3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.900784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a1d141f6af4fdeb4726bb1c88d651c', 'request_id': 'req-3b6d3552-b9a7-4517-a92d-35c04b8edee3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.915758 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] The token cache is being invalidate because project 30a1d141f6af4fdeb4726bb1c88d651c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:37.916129 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.916884 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-3b6d3552-b9a7-4517-a92d-35c04b8edee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:37.919664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1373/2759] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:37 2022] DELETE /identity/v3/projects/30a1d141f6af4fdeb4726bb1c88d651c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:37.923960 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:37.924459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:37.924560 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:37.942948 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:37.944468 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:38.009054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1387/2760] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:38.017120 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.017746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.018045 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.037963 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:38.039281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:38.048592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1374/2761] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:38.053221 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.063232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa944c-d75b-4736-8e9e-ef5e3e9f29f7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.069626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.070318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.070586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.070858 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.071658 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:38.071966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.073616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.087457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1388/2762] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:27:38.092046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.102224 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f854ec-dbf3-4a1b-94a6-e5ac12ac2fb1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.107233 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.107892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.114040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.114040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.114040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.114040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.220682 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.222618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1375/2763] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:38 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:38.232120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969491aa-bf69-4d41-a273-d5b19cf82eda admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.298177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.299006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.299305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.299604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.300295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.302242 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.401232 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1389/2764] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:38 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:38.402501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.413385 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9794e6-6c9f-459e-bf1d-19464f0800a4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.418069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.418972 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.419343 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.419625 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.420356 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.421941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.436163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1376/2765] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:38.438248 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.448572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d522c-c144-4e0e-ab0b-9886e903755d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.453210 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f125-1b3b-4e04-a94c-5c31a8eb33da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.453997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f125-1b3b-4e04-a94c-5c31a8eb33da admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.454889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f125-1b3b-4e04-a94c-5c31a8eb33da admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.455227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f125-1b3b-4e04-a94c-5c31a8eb33da admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.455907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f125-1b3b-4e04-a94c-5c31a8eb33da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.457578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f125-1b3b-4e04-a94c-5c31a8eb33da admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.467526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1390/2766] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:38.471920 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.481823 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b4a62-3133-4bcc-80a7-823f11d1b232 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.486692 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.487609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.487892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.488172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] PATH_INFO: `/v3/projects/714c8a78b72040e0af9d93aa725375e1/users/135c3927def14f5c989dcd04f30011ab/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.504342 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=714c8a78b72040e0af9d93aa725375e1, user_id=135c3927def14f5c989dcd04f30011ab, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.518006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.596108 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1377/2767] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:38 2022] PUT /identity/v3/projects/714c8a78b72040e0af9d93aa725375e1/users/135c3927def14f5c989dcd04f30011ab/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:38.609228 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.609749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.610113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.639217 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] MFA Rules not processed for user `135c3927def14f5c989dcd04f30011ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:38.640434 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:38.712856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1391/2768] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:38.717613 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.787480 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1947771-4fd2-4797-9cc3-33abc2570e5f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.792346 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.793001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.793281 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.793555 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.794255 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.796570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:38.896903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1378/2769] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:38 2022] POST /identity/v3/projects => generated 409 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:38.898136 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:38.910250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a47c10-26a6-4a9a-ae6a-a6efb144ca80 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:38.993577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:38.994352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:38.994617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:38.995018 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:38.995886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:38.997936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:39.092683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1392/2770] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:38 2022] POST /identity/v3/users => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:39.094252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:39.105126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efe939-1f7e-446e-8df7-ed6ec8889487 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:39.109917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:39.110930 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.111438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.111793 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.112604 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:39.114285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:39.125296 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1379/2771] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:39.130510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:39.141211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b613-6c24-4586-86f9-93a400885691 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:39.147102 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:39.148618 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.148902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.149570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] PATH_INFO: `/v3/projects/3d77ed253eb24526b27174c293a55c23/users/04479f0a02be4aacb203fc3f0db534b5/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.167741 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d77ed253eb24526b27174c293a55c23, user_id=04479f0a02be4aacb203fc3f0db534b5, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:39.171087 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:39.272496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1393/2772] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:39 2022] PUT /identity/v3/projects/3d77ed253eb24526b27174c293a55c23/users/04479f0a02be4aacb203fc3f0db534b5/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:39.276440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:39.287784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42978-c5ec-4004-89c5-95f381f56c2f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:39.355458 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ab18-f339-41ac-883c-a5f0121204d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:39.356137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ab18-f339-41ac-883c-a5f0121204d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.356423 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ab18-f339-41ac-883c-a5f0121204d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.356703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ab18-f339-41ac-883c-a5f0121204d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.357439 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06ab18-f339-41ac-883c-a5f0121204d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:39.359077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06ab18-f339-41ac-883c-a5f0121204d6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:39.369837 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1380/2773] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:39.374350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:39.387069 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa4df-6798-468a-a14f-c7fe67dfe231 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:39.392572 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:39.393599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.393883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.394164 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] PATH_INFO: `/v3/projects/3d77ed253eb24526b27174c293a55c23/users/04479f0a02be4aacb203fc3f0db534b5/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.396258 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d77ed253eb24526b27174c293a55c23, user_id=04479f0a02be4aacb203fc3f0db534b5, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:39.398908 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:39.461617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1394/2774] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:39 2022] PUT /identity/v3/projects/3d77ed253eb24526b27174c293a55c23/users/04479f0a02be4aacb203fc3f0db534b5/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:39.472946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e580e-4d4d-430e-949c-fbb489a1cfcf None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.473236 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e580e-4d4d-430e-949c-fbb489a1cfcf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.473542 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e580e-4d4d-430e-949c-fbb489a1cfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.501927 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-375e580e-4d4d-430e-949c-fbb489a1cfcf None None] MFA Rules not processed for user `04479f0a02be4aacb203fc3f0db534b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:39.503280 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-375e580e-4d4d-430e-949c-fbb489a1cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:39.573134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1381/2775] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:39.583839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:39.585610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:39.649736 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ce19-19d7-46b0-8c16-ccee99f74d4e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:39.653538 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:39.654257 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.654616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.654902 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.665413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:39.667027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:39.677185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1395/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:39.888825 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:39.889286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:39.889484 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:39.909322 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:39.910617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:39.967367 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1382/2777] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:27:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:40.102196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:40.117689 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7291434-31b3-4ac5-a382-3168c84afd50 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:40.119899 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:40.121569 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:40.123510 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01208e5-7b88-4ef1-9427-52dfc8e483a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:40.124660 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01208e5-7b88-4ef1-9427-52dfc8e483a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:40.125201 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01208e5-7b88-4ef1-9427-52dfc8e483a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:40.125655 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01208e5-7b88-4ef1-9427-52dfc8e483a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:40.216139 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01208e5-7b88-4ef1-9427-52dfc8e483a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:40.217770 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01208e5-7b88-4ef1-9427-52dfc8e483a2 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:40.227866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a309bd-4521-4b03-a288-6df6316528e2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:40.228577 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1396/2778] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:40.233122 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:40.236580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:40.236580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:40.236580 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:40.243950 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:40.245598 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:40.254677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1383/2779] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:27:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:27:41.152417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7738-6ec4-444c-8ea9-37283845ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:41.152929 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7738-6ec4-444c-8ea9-37283845ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:41.153120 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7738-6ec4-444c-8ea9-37283845ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:41.186039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aa5d7738-6ec4-444c-8ea9-37283845ffe4 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:41.186039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa5d7738-6ec4-444c-8ea9-37283845ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:41.186039 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1397/2780] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:41.195999 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:41.207159 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fefb6a-ae66-4176-93a4-8782cef98d4c service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:41.212545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:41.213190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:41.213479 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:41.213762 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:41.222761 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:41.224378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:41.233194 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1384/2781] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:27:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 18:27:41.884918 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc0316-668a-4545-b032-1fd567bdaef2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:41.885208 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc0316-668a-4545-b032-1fd567bdaef2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:41.885512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc0316-668a-4545-b032-1fd567bdaef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:41.904151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bbdc0316-668a-4545-b032-1fd567bdaef2 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:41.905400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bbdc0316-668a-4545-b032-1fd567bdaef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:41.913733 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1398/2782] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:41.926164 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:41.936879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e29f-390b-4be9-8776-c9fb54aeeed8 service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:41.942617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:41.943323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:41.943609 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:41.943898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:41.952426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:41.954623 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:41.962897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1385/2783] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:27:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:27:42.586170 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:42.586671 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:42.586773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:42.604436 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:42.605630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:42.613708 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1399/2784] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:42.625786 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:42.637204 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1325-3100-4fa1-b705-b261cfcc7a4b service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:42.642338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca286ef-d2e5-4a1f-a2b5-d0bee9d68d47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:42.643001 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca286ef-d2e5-4a1f-a2b5-d0bee9d68d47 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:42.643326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca286ef-d2e5-4a1f-a2b5-d0bee9d68d47 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:42.643605 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca286ef-d2e5-4a1f-a2b5-d0bee9d68d47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:42.652011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca286ef-d2e5-4a1f-a2b5-d0bee9d68d47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:42.653591 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca286ef-d2e5-4a1f-a2b5-d0bee9d68d47 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:42.663097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1386/2785] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:27:48.398613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:48.400078 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:48.494616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084867a7-7840-4b28-865a-676dfb3c69a5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:48.499549 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:48.500522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:48.500907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:48.501419 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] PATH_INFO: `/v3/users/8619dd8583734dfcb6d1eec3f1075b10` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:48.502807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8619dd8583734dfcb6d1eec3f1075b10)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:48.504847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:48.674759 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8619dd8583734dfcb6d1eec3f1075b10'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:48.686794 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8619dd8583734dfcb6d1eec3f1075b10'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:48.687647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8619dd8583734dfcb6d1eec3f1075b10'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:48.688852 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8619dd8583734dfcb6d1eec3f1075b10'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:48.745607 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8619dd8583734dfcb6d1eec3f1075b10'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:48.758732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1400/2786] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:48 2022] DELETE /identity/v3/users/8619dd8583734dfcb6d1eec3f1075b10 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:48.763245 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:48.763734 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:48.763836 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:48.790813 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:48.792024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:48.850557 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1387/2787] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:48.860521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:48.861953 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:48.943150 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f07f-9b5d-4821-a5e4-a8db39edc101 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:48.946873 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64b1bd-259f-4e64-a4a7-c0bf0209fceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:48.947578 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64b1bd-259f-4e64-a4a7-c0bf0209fceb service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:48.947869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64b1bd-259f-4e64-a4a7-c0bf0209fceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:48.948146 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64b1bd-259f-4e64-a4a7-c0bf0209fceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:48.958537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64b1bd-259f-4e64-a4a7-c0bf0209fceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:48.960081 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64b1bd-259f-4e64-a4a7-c0bf0209fceb service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:48.970251 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1401/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:49.197982 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:49.199020 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:49.216731 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6afacc-b2a9-4f79-bf68-73c2629a5693 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:49.223026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:49.224134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.224426 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.224702 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] PATH_INFO: `/v3/projects/7b90f4bf16694a2d9d5999f3f8870912` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.225938 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b90f4bf16694a2d9d5999f3f8870912)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:49.228121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:49.364192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b90f4bf16694a2d9d5999f3f8870912', 'request_id': 'req-40171ad9-07bc-4b59-ba88-55b832ca2bf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:49.443507 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b90f4bf16694a2d9d5999f3f8870912', 'request_id': 'req-40171ad9-07bc-4b59-ba88-55b832ca2bf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:49.450372 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b90f4bf16694a2d9d5999f3f8870912', 'request_id': 'req-40171ad9-07bc-4b59-ba88-55b832ca2bf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:49.463516 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] The token cache is being invalidate because project 7b90f4bf16694a2d9d5999f3f8870912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:49.463875 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:49.464701 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-40171ad9-07bc-4b59-ba88-55b832ca2bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:49.466467 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1388/2789] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:49 2022] DELETE /identity/v3/projects/7b90f4bf16694a2d9d5999f3f8870912 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:49.472064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.472664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.472664 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.511886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:49.513967 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:49.575847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1402/2790] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:49.587674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.587977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.588262 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.608365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:49.609592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:49.619023 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1389/2791] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:49.623005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:49.634027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79ad7-30b6-4f83-aba2-8449dd1dc3d7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:49.638818 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:49.639519 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.639801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.640241 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.640965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:49.641364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:49.643007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:49.654713 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1403/2792] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:27:49.659526 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:49.659796 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:49.660947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:49.671030 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1798-389f-4893-b009-5d3e7a69842c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:49.676506 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:49.677163 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.677450 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.677729 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.678509 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:49.680459 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:49.735855 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1665b-84e1-4069-bb7f-e60d257c90ab None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:49.743672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:49.744383 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.744665 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.744942 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.747251 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:49.760347 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:49.761936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:49.773462 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1390/2793] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:49.802570 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1404/2794] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:49 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:49.806955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:49.817561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bfbf6-f3b5-4005-8a81-e44cee304141 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:49.882060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:49.882703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:49.883005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:49.883302 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:49.884049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:49.886039 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:49.988817 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1391/2795] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:49 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:49.992869 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:50.003137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3828948-3a1a-4b91-8d50-2988fe606e56 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:50.007885 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:50.008533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:50.008817 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:50.009091 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:50.010388 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:50.011500 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:50.022015 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1405/2796] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:50.025979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:50.037191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989712-980f-4cda-866e-99b2d9c1a847 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:50.041879 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0d8c-367d-4190-8a0b-6982b4eef23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:50.042551 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0d8c-367d-4190-8a0b-6982b4eef23e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:50.042834 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0d8c-367d-4190-8a0b-6982b4eef23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:50.043172 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0d8c-367d-4190-8a0b-6982b4eef23e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:50.043914 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd0d8c-367d-4190-8a0b-6982b4eef23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:50.045614 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd0d8c-367d-4190-8a0b-6982b4eef23e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:50.056341 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1392/2797] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:50.060542 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:50.070750 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3ce6-ba1e-4905-aa81-b2378ef64bcd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:50.075494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:50.076372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:50.076649 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:50.076920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] PATH_INFO: `/v3/projects/1866b3ae05f944c89bbaa6f19f66c878/users/b17bc7ac016a40f7bd8ff7357d7df17c/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:50.093588 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1866b3ae05f944c89bbaa6f19f66c878, user_id=b17bc7ac016a40f7bd8ff7357d7df17c, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:50.097317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:50.163990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1406/2798] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:50 2022] PUT /identity/v3/projects/1866b3ae05f944c89bbaa6f19f66c878/users/b17bc7ac016a40f7bd8ff7357d7df17c/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:50.174588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2b5c2-1326-48da-ab27-6591d5fce42f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:50.174886 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2b5c2-1326-48da-ab27-6591d5fce42f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:50.175209 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2b5c2-1326-48da-ab27-6591d5fce42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:50.193759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8ee2b5c2-1326-48da-ab27-6591d5fce42f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:50.195011 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8ee2b5c2-1326-48da-ab27-6591d5fce42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:50.254032 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1393/2799] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:50.263757 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:50.265426 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:50.322227 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837b95-6d75-4a1f-a070-a0a45dabea0e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:50.325933 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:50.326907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:50.326907 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:50.327168 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:50.337141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:50.338881 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:50.348611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1407/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:51.864124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:51.864735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:51.864735 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:51.895344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] MFA Rules not processed for user `b17bc7ac016a40f7bd8ff7357d7df17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:51.896570 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:51.974152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1394/2801] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:51.988707 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:51.990183 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:52.046516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd4177-99df-414e-91b9-6357ad4bcde9 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:52.050495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8009b88-0929-463b-9887-43e7c811f54c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:52.051178 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009b88-0929-463b-9887-43e7c811f54c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:52.051467 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009b88-0929-463b-9887-43e7c811f54c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:52.051748 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009b88-0929-463b-9887-43e7c811f54c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:52.060352 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8009b88-0929-463b-9887-43e7c811f54c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:52.061793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8009b88-0929-463b-9887-43e7c811f54c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:52.071191 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1408/2802] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:52.312902 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:52.314365 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:52.327898 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2684-543c-4f28-b314-fff2fc74a64b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:52.333059 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:52.333892 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:52.334197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:52.334472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] PATH_INFO: `/v3/users/135c3927def14f5c989dcd04f30011ab` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:52.335664 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=135c3927def14f5c989dcd04f30011ab)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:52.337575 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:52.589265 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135c3927def14f5c989dcd04f30011ab'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:52.590034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135c3927def14f5c989dcd04f30011ab'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:52.602050 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135c3927def14f5c989dcd04f30011ab'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:52.605744 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135c3927def14f5c989dcd04f30011ab'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:52.700175 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135c3927def14f5c989dcd04f30011ab'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:52.713691 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1395/2803] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:52 2022] DELETE /identity/v3/users/135c3927def14f5c989dcd04f30011ab => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:52.718198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:52.718490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:52.718760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:52.735626 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:52.737569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:52.794718 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1409/2804] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:52.805166 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:52.806571 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:52.866190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072afc2-50be-4bf0-9a7d-f2e3d8f24bdb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:52.872527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:52.872527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:52.872527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:52.872527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:52.881091 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:52.882515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:52.892306 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1396/2805] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:53.342505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:53.342505 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:53.353988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05395b-6444-4bd4-ae4a-0e9253bfc19f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:53.358931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:53.365597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:53.365597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:53.365597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] PATH_INFO: `/v3/projects/714c8a78b72040e0af9d93aa725375e1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:53.365597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714c8a78b72040e0af9d93aa725375e1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:53.366284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:53.462633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714c8a78b72040e0af9d93aa725375e1', 'request_id': 'req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.591327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714c8a78b72040e0af9d93aa725375e1', 'request_id': 'req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.597597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714c8a78b72040e0af9d93aa725375e1', 'request_id': 'req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.608496 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] The token cache is being invalidate because project 714c8a78b72040e0af9d93aa725375e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:53.608797 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.609417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b03026c2-f7ea-4e7a-84b3-b76f38dd6028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.610973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1410/2806] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:53 2022] DELETE /identity/v3/projects/714c8a78b72040e0af9d93aa725375e1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:53.615751 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:53.625979 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894a3f-0962-4211-894c-ed8acde7aa9d service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:53.688473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:53.689961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:53.690448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:53.690918 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] PATH_INFO: `/v3/users/04479f0a02be4aacb203fc3f0db534b5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:53.692200 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04479f0a02be4aacb203fc3f0db534b5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:53.694169 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:53.888618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04479f0a02be4aacb203fc3f0db534b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.889271 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04479f0a02be4aacb203fc3f0db534b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.902284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04479f0a02be4aacb203fc3f0db534b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.903071 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04479f0a02be4aacb203fc3f0db534b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:53.928883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:53.929167 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:53.929447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:53.947640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] MFA Rules not processed for user `b17bc7ac016a40f7bd8ff7357d7df17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:53.948839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:54.002890 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1411/2807] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:27:54.016676 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c2fc09c9-f8e0-408d-86a2-5d692753fe70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04479f0a02be4aacb203fc3f0db534b5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:54.030066 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1397/2808] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:27:53 2022] DELETE /identity/v3/users/04479f0a02be4aacb203fc3f0db534b5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:54.501705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:54.503768 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:54.518534 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96048d-97e9-4ff0-9b7f-24e8615a0f5f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:54.576034 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:54.576889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:54.577175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:54.577451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] PATH_INFO: `/v3/projects/3d77ed253eb24526b27174c293a55c23` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:54.578672 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d77ed253eb24526b27174c293a55c23)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:54.581722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:54.691856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d77ed253eb24526b27174c293a55c23', 'request_id': 'req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:54.765255 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d77ed253eb24526b27174c293a55c23', 'request_id': 'req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:54.775395 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d77ed253eb24526b27174c293a55c23', 'request_id': 'req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:54.784359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] The token cache is being invalidate because project 3d77ed253eb24526b27174c293a55c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:27:54.784650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:54.785319 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7b9e1ef-f1f7-4847-bbc2-27d50698c2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:27:54.787211 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1412/2809] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:27:54 2022] DELETE /identity/v3/projects/3d77ed253eb24526b27174c293a55c23 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:54.792931 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:54.793232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:54.793513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:54.823519 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:54.824741 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:54.885232 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1398/2810] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:54.894512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:54.895567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:54.895567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:54.915132 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:54.916350 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:54.924761 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1413/2811] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:54.929099 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:54.938872 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3452a-2a07-4895-a9c2-5a784b896b21 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:54.944882 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:54.945540 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:54.953028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:54.953028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:54.953028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:27:54.953028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:54.953028 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:54.961909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1399/2812] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:27:54.966318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:54.975629 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226b599-8409-4187-8ed4-722ce466a69b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:54.980619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:54.981443 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:54.981732 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:54.982007 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:54.982696 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:54.984639 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:55.097033 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1414/2813] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:27:54 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:27:55.101435 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:55.112443 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b10c7-9f7a-4de6-8a96-2064ba4e8fca admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:55.170749 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:55.171588 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:55.172087 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:55.172424 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:55.173410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:55.176913 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:55.271852 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1400/2814] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:27:55 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:27:55.275947 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:55.286699 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7404-dbd8-40cd-bde4-94e4c52881db admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:55.291373 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:55.292031 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:55.292332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:55.292617 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:55.293344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:55.294944 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:55.306473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1415/2815] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:55.310476 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:55.321515 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5835-df5a-4193-a23e-a6504e4699bb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:55.326329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9a55-89d0-4227-ac9b-772e89e7e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:55.334627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9a55-89d0-4227-ac9b-772e89e7e312 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:55.334627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9a55-89d0-4227-ac9b-772e89e7e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:55.334627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9a55-89d0-4227-ac9b-772e89e7e312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:55.334627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb9a55-89d0-4227-ac9b-772e89e7e312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:55.334627 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb9a55-89d0-4227-ac9b-772e89e7e312 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:55.344527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1401/2816] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:27:55.345778 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:55.357149 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9d86c-1b0b-4a79-be44-18f1d84efa3d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:55.362327 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:55.363238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:55.363575 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:55.363855 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] PATH_INFO: `/v3/projects/f076ce9d235245abbd20ccb7dd5a5b27/users/bac74bf265a848cdba787de5b73129ad/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:55.380681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f076ce9d235245abbd20ccb7dd5a5b27, user_id=bac74bf265a848cdba787de5b73129ad, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:55.383521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:55.457137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1416/2817] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:27:55 2022] PUT /identity/v3/projects/f076ce9d235245abbd20ccb7dd5a5b27/users/bac74bf265a848cdba787de5b73129ad/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:27:55.468753 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758c834-f577-4080-90e2-bc7ddd155abf None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:55.469049 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758c834-f577-4080-90e2-bc7ddd155abf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:55.469329 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758c834-f577-4080-90e2-bc7ddd155abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:55.497698 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a758c834-f577-4080-90e2-bc7ddd155abf None None] MFA Rules not processed for user `bac74bf265a848cdba787de5b73129ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:55.498909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a758c834-f577-4080-90e2-bc7ddd155abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:55.565941 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1402/2818] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:27:55.576980 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:27:55.578760 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:55.636307 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9271b-ffa9-4b7a-8343-76e050ebe5ef admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:27:55.640005 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7559dd645048dd99a4b8a5d3537230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:27:55.640650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:55.640935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:55.641238 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:55.650571 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:27:55.652040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:27:55.661769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1417/2819] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:27:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:27:58.608448 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2465406-6f9b-425e-a0ad-d17de7e1733c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:27:58.609093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2465406-6f9b-425e-a0ad-d17de7e1733c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:27:58.609257 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2465406-6f9b-425e-a0ad-d17de7e1733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:27:58.633037 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e2465406-6f9b-425e-a0ad-d17de7e1733c None None] MFA Rules not processed for user `0f6129531b1a448b9d7eae86be2a8c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:27:58.634615 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e2465406-6f9b-425e-a0ad-d17de7e1733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:27:58.699868 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1403/2820] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:20.188284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:20.251862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943e90-7dba-405d-9f23-8b901f6c88c1 service glance] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:20.256288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:20.257693 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:20.258019 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:20.258288 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] PATH_INFO: `/v3/users/bac74bf265a848cdba787de5b73129ad` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:20.259512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac74bf265a848cdba787de5b73129ad)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:20.261413 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:20.478057 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac74bf265a848cdba787de5b73129ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:20.491988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac74bf265a848cdba787de5b73129ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:20.492698 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac74bf265a848cdba787de5b73129ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:20.493302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac74bf265a848cdba787de5b73129ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:20.568473 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac74bf265a848cdba787de5b73129ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:20.582859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1418/2821] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:28:20 2022] DELETE /identity/v3/users/bac74bf265a848cdba787de5b73129ad => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:28:20.588381 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:20.598936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:20.598936 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:20.612807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:20.614126 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:20.703454 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1404/2822] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:20.715931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:20.718092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:20.779636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625eda7-ef28-4c40-a8ff-e9145928e909 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:20.783310 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3869c8-9105-480c-b19e-1b01e309a5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:20.783958 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3869c8-9105-480c-b19e-1b01e309a5cc service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:20.784330 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3869c8-9105-480c-b19e-1b01e309a5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:20.784640 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3869c8-9105-480c-b19e-1b01e309a5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:20.795905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3869c8-9105-480c-b19e-1b01e309a5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:20.797403 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3869c8-9105-480c-b19e-1b01e309a5cc service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:20.807839 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1419/2823] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:28:21.337792 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:21.339487 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:21.353532 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978875f3-4482-4106-a7a2-6517ae9c7c0e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:21.358589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:21.359612 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:21.359996 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:21.360382 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] PATH_INFO: `/v3/projects/f076ce9d235245abbd20ccb7dd5a5b27` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:21.361703 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f076ce9d235245abbd20ccb7dd5a5b27)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:21.365677 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:21.473453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f076ce9d235245abbd20ccb7dd5a5b27', 'request_id': 'req-ac85d417-7241-4129-a741-0d4f1b95899d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:21.513016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f076ce9d235245abbd20ccb7dd5a5b27', 'request_id': 'req-ac85d417-7241-4129-a741-0d4f1b95899d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:21.518770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f076ce9d235245abbd20ccb7dd5a5b27', 'request_id': 'req-ac85d417-7241-4129-a741-0d4f1b95899d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:21.530167 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] The token cache is being invalidate because project f076ce9d235245abbd20ccb7dd5a5b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:28:21.530452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:21.531106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ac85d417-7241-4129-a741-0d4f1b95899d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:21.532638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1405/2824] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:28:21 2022] DELETE /identity/v3/projects/f076ce9d235245abbd20ccb7dd5a5b27 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:28:21.537804 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:21.543783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:21.543783 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:21.556400 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:21.557648 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:21.617879 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1420/2825] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:21.625780 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:21.626248 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:21.626348 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:21.645784 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:21.648112 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:21.657492 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1406/2826] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:21.662054 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:21.673109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200d2b-2e47-4868-998b-4ee910c3b016 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:21.678113 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:21.678847 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:21.679175 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:21.679451 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:21.680174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:28:21.680513 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:21.682105 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:21.697988 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1421/2827] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:28:21.704848 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:21.709572 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c66f4-add2-4ba4-994c-85cc3bf3987f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:21.715093 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:21.715812 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:21.716191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:21.716472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:21.717249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:21.719264 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:21.817959 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1407/2828] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:28:21 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:28:21.822601 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:21.833295 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a5c9-919f-42c3-836f-4c2ee81ed085 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:21.890914 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:21.891522 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:21.891805 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:21.892076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:21.892754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:21.895883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:21.999495 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1422/2829] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:28:21 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:28:22.003592 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:22.014860 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c840cf5-b098-48e9-bce5-58e9f460316c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:22.020252 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b0957-1000-4653-b475-957a6793377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:22.021022 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b0957-1000-4653-b475-957a6793377b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:22.021410 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b0957-1000-4653-b475-957a6793377b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:22.021822 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b0957-1000-4653-b475-957a6793377b admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:22.023712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b0957-1000-4653-b475-957a6793377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:22.025445 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b0957-1000-4653-b475-957a6793377b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:22.036601 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1408/2830] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:28:22.040802 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:22.051597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400426-1149-4c9b-9628-6cde0ac1df3f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:22.057546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56314b-3b87-4a62-9d55-70c23e8a5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:22.058213 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56314b-3b87-4a62-9d55-70c23e8a5963 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:22.058499 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56314b-3b87-4a62-9d55-70c23e8a5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:22.058819 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56314b-3b87-4a62-9d55-70c23e8a5963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:22.059537 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56314b-3b87-4a62-9d55-70c23e8a5963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:22.061240 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56314b-3b87-4a62-9d55-70c23e8a5963 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:22.072193 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1423/2831] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:28:22.076560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b0957-1000-4653-b475-957a6793377b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:22.087173 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b0957-1000-4653-b475-957a6793377b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:22.091781 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:22.092651 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:22.092934 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:22.093214 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] PATH_INFO: `/v3/projects/aecd18d83f0943bbb4040c13d8a36bb5/users/007779d7f6dc4b4cb599cc7fb4b2a237/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:22.108638 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecd18d83f0943bbb4040c13d8a36bb5, user_id=007779d7f6dc4b4cb599cc7fb4b2a237, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:22.111425 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:22.656103 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1409/2832] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:28:22 2022] PUT /identity/v3/projects/aecd18d83f0943bbb4040c13d8a36bb5/users/007779d7f6dc4b4cb599cc7fb4b2a237/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:28:22.667536 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:22.668043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:22.668154 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:22.694809 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] MFA Rules not processed for user `007779d7f6dc4b4cb599cc7fb4b2a237`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:22.696063 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:22.759942 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1424/2833] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:22.771415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:22.773279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:22.857297 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89f536-3625-4a6b-90ee-03132ecc7566 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:22.861070 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c208c-5773-47fb-8db6-ba3ce4c69d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:22.861760 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c208c-5773-47fb-8db6-ba3ce4c69d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:22.862030 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c208c-5773-47fb-8db6-ba3ce4c69d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:22.862603 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c208c-5773-47fb-8db6-ba3ce4c69d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:22.872806 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c208c-5773-47fb-8db6-ba3ce4c69d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:22.874291 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c208c-5773-47fb-8db6-ba3ce4c69d84 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:22.883152 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1410/2834] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:28:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:28:33.225244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:33.286969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6dd4e-c39d-4a82-8e19-78b479721409 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:33.292059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:33.292962 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:33.293244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:33.293520 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] PATH_INFO: `/v3/users/007779d7f6dc4b4cb599cc7fb4b2a237` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:33.294703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007779d7f6dc4b4cb599cc7fb4b2a237)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:33.296694 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:33.497151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007779d7f6dc4b4cb599cc7fb4b2a237'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:33.508665 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007779d7f6dc4b4cb599cc7fb4b2a237'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:33.509370 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007779d7f6dc4b4cb599cc7fb4b2a237'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:33.510011 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007779d7f6dc4b4cb599cc7fb4b2a237'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:33.564025 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51b69642-bcaf-44cb-8544-aa152a1a09c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007779d7f6dc4b4cb599cc7fb4b2a237'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:33.577489 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1425/2835] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:28:33 2022] DELETE /identity/v3/users/007779d7f6dc4b4cb599cc7fb4b2a237 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:28:33.582231 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:33.582745 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:33.582917 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:33.604144 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:33.605362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:33.649583 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:33.649956 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:33.650915 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:33.667554 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1411/2836] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:33.670006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:33.671610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:33.677344 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:33.678717 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:33.729076 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1426/2837] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:28:33.736567 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575be54-7a2d-42bd-9463-633f484db0d8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:33.741657 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:33.741859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:33.742420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:33.742712 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:33.743038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:33.743527 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:33.754187 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:33.755661 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:33.768366 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1412/2838] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:28:33.817189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130925-db36-42b6-a7ed-bdc52ab5447f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:33.823533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a2fd-54cb-4943-a77d-7bd437b5605b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:33.824214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a2fd-54cb-4943-a77d-7bd437b5605b service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:33.824494 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a2fd-54cb-4943-a77d-7bd437b5605b service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:33.824766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a2fd-54cb-4943-a77d-7bd437b5605b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:33.833824 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23a2fd-54cb-4943-a77d-7bd437b5605b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:33.835438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23a2fd-54cb-4943-a77d-7bd437b5605b service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:33.845723 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1427/2839] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:28:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:28:34.232645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:34.234544 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:34.263249 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd833e7-1f8c-418b-a318-bba6fff791ed service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:34.268772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:34.269826 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.270217 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.270642 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] PATH_INFO: `/v3/projects/aecd18d83f0943bbb4040c13d8a36bb5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.272006 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecd18d83f0943bbb4040c13d8a36bb5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:34.274128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:34.369275 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecd18d83f0943bbb4040c13d8a36bb5', 'request_id': 'req-4b641c1e-9a99-4425-8309-4292ad848978'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:34.427110 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecd18d83f0943bbb4040c13d8a36bb5', 'request_id': 'req-4b641c1e-9a99-4425-8309-4292ad848978'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:34.434061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecd18d83f0943bbb4040c13d8a36bb5', 'request_id': 'req-4b641c1e-9a99-4425-8309-4292ad848978'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:34.446771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] The token cache is being invalidate because project aecd18d83f0943bbb4040c13d8a36bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:28:34.447876 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:34.449254 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b641c1e-9a99-4425-8309-4292ad848978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:28:34.450862 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1413/2840] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:28:34 2022] DELETE /identity/v3/projects/aecd18d83f0943bbb4040c13d8a36bb5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:28:34.457022 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.457533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.457712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.477605 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:34.479735 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:34.544028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1428/2841] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:34.553413 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.553706 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.553988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.574359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:34.575674 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:34.586080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1414/2842] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:28:34.590619 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:34.600871 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f203-4185-4065-a049-b5456d101c70 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:34.606807 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:34.607563 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.607856 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.608137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.608910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:28:34.609233 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:34.610952 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:34.627977 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1429/2843] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:28:34.629529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:34.640005 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ccc23-e227-4ea5-8962-efd7a2f671f9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:34.644861 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:34.645552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.645838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.646115 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.646809 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:34.648867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:34.738770 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1415/2844] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:28:34 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:28:34.742965 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:34.755265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc814-43fc-4e6b-8486-0f385588938e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:34.824265 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:34.824992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.825284 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.825569 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.826344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:34.828479 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:34.913703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1430/2845] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:28:34 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:28:34.918599 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:34.930326 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841e7e8-126c-4f55-a110-681dc7bc99c7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:34.937376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:34.938157 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.938543 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.938929 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.940003 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:34.941831 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:34.957590 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1416/2846] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:28:34.961717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:34.973528 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abd2d-2051-4d67-a01b-c122e520dd07 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:34.980138 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81271f7c-e098-461a-8219-336a61736c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:34.981048 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81271f7c-e098-461a-8219-336a61736c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:34.981638 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81271f7c-e098-461a-8219-336a61736c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:34.982090 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81271f7c-e098-461a-8219-336a61736c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:34.983111 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81271f7c-e098-461a-8219-336a61736c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:34.984931 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81271f7c-e098-461a-8219-336a61736c58 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:35.000774 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1431/2847] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:28:35.002258 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:35.016628 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21980e2-cc57-42f7-a5d6-154d7e8a0ead admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:35.022237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:35.023154 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:35.023546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:35.023946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] PATH_INFO: `/v3/projects/c230e0f1593e4a03ab66d99d898e99e9/users/1c804058b3c94a7b976ba5118d343d49/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:35.048546 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c230e0f1593e4a03ab66d99d898e99e9, user_id=1c804058b3c94a7b976ba5118d343d49, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:35.051473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:35.130948 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1417/2848] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:28:35 2022] PUT /identity/v3/projects/c230e0f1593e4a03ab66d99d898e99e9/users/1c804058b3c94a7b976ba5118d343d49/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:28:35.142516 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089f1df-7900-4c43-8933-1062d620faf7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:35.142893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089f1df-7900-4c43-8933-1062d620faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:35.143342 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089f1df-7900-4c43-8933-1062d620faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:35.174935 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2089f1df-7900-4c43-8933-1062d620faf7 None None] MFA Rules not processed for user `1c804058b3c94a7b976ba5118d343d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:35.176367 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2089f1df-7900-4c43-8933-1062d620faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:35.265137 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1432/2849] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:28:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:35.276773 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:35.278586 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:35.346617 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123266-cfc4-41f0-bd8c-87865d711132 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:35.353973 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:35.354783 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:35.355840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:35.355840 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:35.375801 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:35.378324 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:35.393089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1418/2850] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:28:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:28:50.830936 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:50.831442 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:50.831540 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:50.851709 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] MFA Rules not processed for user `15b8dc2e53bb436ab21bf6559244c7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:28:50.853652 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:50.917447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1433/2851] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:28:50.930323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:28:50.932015 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:28:51.002016 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158016-a644-4602-9a1f-f881e534f845 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:28:51.007111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ec426f2eb64bb4b480b5ad42a43410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:28:51.007759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:28:51.008038 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:28:51.008311 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:28:51.017276 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:28:51.018901 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:28:51.027069 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1419/2852] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 18:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:29:01.461887 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:29:01.464592 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:29:01.533498 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964446a-6929-42a2-a7d2-ed9c15f52c08 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:29:01.538565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:29:01.539300 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:01.539586 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:01.539903 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] PATH_INFO: `/v3/users/0f6129531b1a448b9d7eae86be2a8c00` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:01.541109 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6129531b1a448b9d7eae86be2a8c00)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:29:01.544244 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:29:01.728438 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6129531b1a448b9d7eae86be2a8c00'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:01.739730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6129531b1a448b9d7eae86be2a8c00'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:01.740417 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6129531b1a448b9d7eae86be2a8c00'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:01.741028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6129531b1a448b9d7eae86be2a8c00'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:01.825801 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6129531b1a448b9d7eae86be2a8c00'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:01.839041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1434/2853] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:29:01 2022] DELETE /identity/v3/users/0f6129531b1a448b9d7eae86be2a8c00 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:29:02.082909 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:29:02.094290 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbfca3-1200-4caf-9d01-ecbd8449e92f service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:29:02.152843 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:29:02.153733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:02.154017 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:02.154323 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] PATH_INFO: `/v3/projects/309b01b9d92e4ede9ae5840b7b6dc843` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:02.155560 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=309b01b9d92e4ede9ae5840b7b6dc843)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:29:02.157468 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:29:02.278881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309b01b9d92e4ede9ae5840b7b6dc843', 'request_id': 'req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:02.351533 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309b01b9d92e4ede9ae5840b7b6dc843', 'request_id': 'req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:02.358375 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309b01b9d92e4ede9ae5840b7b6dc843', 'request_id': 'req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:02.370286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] The token cache is being invalidate because project 309b01b9d92e4ede9ae5840b7b6dc843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:29:02.370565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:02.371219 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e80bdbbd-cbd5-421f-831d-f7fc8c855d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:02.372921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1420/2854] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:29:02 2022] DELETE /identity/v3/projects/309b01b9d92e4ede9ae5840b7b6dc843 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:29:13.207196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:29:13.208595 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:29:13.221627 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558cc30-365b-40d8-83c9-c6ca9566d9ce admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:29:13.276215 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:29:13.276999 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:13.277282 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:13.277557 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] PATH_INFO: `/v3/users/1c804058b3c94a7b976ba5118d343d49` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:13.278728 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c804058b3c94a7b976ba5118d343d49)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:29:13.280721 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:29:13.485045 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c804058b3c94a7b976ba5118d343d49'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:13.496749 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c804058b3c94a7b976ba5118d343d49'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:13.497518 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c804058b3c94a7b976ba5118d343d49'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:13.498177 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c804058b3c94a7b976ba5118d343d49'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:13.577920 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c804058b3c94a7b976ba5118d343d49'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:13.590673 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1435/2855] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:29:13 2022] DELETE /identity/v3/users/1c804058b3c94a7b976ba5118d343d49 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:29:13.596060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:13.596565 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:13.596719 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:13.616277 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:29:13.619002 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:29:13.677183 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1421/2856] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:29:13.688449 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:29:13.689883 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:29:13.747041 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2032e-afdc-478c-97c4-6e5ad222d1a4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:29:13.750681 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a16c-6259-43c8-8dd0-0e55644ed972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:29:13.751351 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a16c-6259-43c8-8dd0-0e55644ed972 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:13.751636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a16c-6259-43c8-8dd0-0e55644ed972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:13.751912 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a16c-6259-43c8-8dd0-0e55644ed972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:13.760838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4a16c-6259-43c8-8dd0-0e55644ed972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:29:13.762275 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4a16c-6259-43c8-8dd0-0e55644ed972 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:29:13.771615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1436/2857] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:29:14.244036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:29:14.245500 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:29:14.258415 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce322725-ad32-4ebb-867d-1f3a13d06852 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:29:14.263128 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:29:14.264024 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:14.264307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:14.264583 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] PATH_INFO: `/v3/projects/c230e0f1593e4a03ab66d99d898e99e9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:14.266401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c230e0f1593e4a03ab66d99d898e99e9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:29:14.268475 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:29:14.395286 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c230e0f1593e4a03ab66d99d898e99e9', 'request_id': 'req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:14.497926 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c230e0f1593e4a03ab66d99d898e99e9', 'request_id': 'req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:14.504464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c230e0f1593e4a03ab66d99d898e99e9', 'request_id': 'req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:14.516531 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] The token cache is being invalidate because project c230e0f1593e4a03ab66d99d898e99e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:29:14.516816 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:14.517452 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:29:14.519042 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1422/2858] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:29:14 2022] DELETE /identity/v3/projects/c230e0f1593e4a03ab66d99d898e99e9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:29:32.177124 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:29:32.177688 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:29:32.177826 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:29:32.194402 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] MFA Rules not processed for user `b17bc7ac016a40f7bd8ff7357d7df17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:29:32.195613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:29:32.255490 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1437/2859] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:30:05.158932 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:05.160501 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:05.250026 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf5b1-4815-4dc1-bb20-2574f0ea16c9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:05.255073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:05.255716 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:05.256004 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:05.256285 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:05.258727 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:05.269977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:05.271756 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:05.282672 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1423/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:30:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:30:42.828683 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:42.829196 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:42.895325 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938340-6a2d-408d-aaf6-7b6fdff7d1e7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:42.900053 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:42.900992 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:42.901270 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:42.901546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] PATH_INFO: `/v3/users/b17bc7ac016a40f7bd8ff7357d7df17c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:42.902727 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17bc7ac016a40f7bd8ff7357d7df17c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:42.904731 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:43.068289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17bc7ac016a40f7bd8ff7357d7df17c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.080097 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17bc7ac016a40f7bd8ff7357d7df17c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.080773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17bc7ac016a40f7bd8ff7357d7df17c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.081372 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17bc7ac016a40f7bd8ff7357d7df17c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.140457 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bb75d7cc-ee59-41ce-ad8c-455f81c89965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17bc7ac016a40f7bd8ff7357d7df17c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.153703 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1438/2861] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:30:42 2022] DELETE /identity/v3/users/b17bc7ac016a40f7bd8ff7357d7df17c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:30:43.388430 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:43.399399 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94220a0-428a-45a2-a840-fc34867caa27 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:43.458547 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:43.459453 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:43.459740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:43.460018 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] PATH_INFO: `/v3/projects/1866b3ae05f944c89bbaa6f19f66c878` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:43.461234 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1866b3ae05f944c89bbaa6f19f66c878)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:43.463190 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:43.582977 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1866b3ae05f944c89bbaa6f19f66c878', 'request_id': 'req-214ef9c3-e08d-46e1-8643-31ebd5985d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.656988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1866b3ae05f944c89bbaa6f19f66c878', 'request_id': 'req-214ef9c3-e08d-46e1-8643-31ebd5985d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.663690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1866b3ae05f944c89bbaa6f19f66c878', 'request_id': 'req-214ef9c3-e08d-46e1-8643-31ebd5985d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.676195 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] The token cache is being invalidate because project 1866b3ae05f944c89bbaa6f19f66c878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:30:43.676485 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.677134 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-214ef9c3-e08d-46e1-8643-31ebd5985d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:30:43.678842 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1424/2862] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:30:43 2022] DELETE /identity/v3/projects/1866b3ae05f944c89bbaa6f19f66c878 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:30:43.683997 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:43.684287 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:43.684565 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:43.702332 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:30:43.703625 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:43.763415 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1439/2863] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:30:43.771845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:43.772158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:43.772440 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:43.791420 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:30:43.792632 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:43.801284 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1425/2864] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:30:43.805523 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:43.815775 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7096cd-1dfb-457b-946e-c43fdf73cf09 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:43.820659 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:43.821335 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:43.821613 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:43.821886 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:43.822604 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:30:43.822910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:43.825273 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:43.837297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1440/2865] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 18:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:30:43.842838 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:43.852073 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071416f4-bbf2-4c52-873e-774d16a57541 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:43.856947 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:43.857594 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:43.857881 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:43.858182 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:43.858891 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:43.860827 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:43.977897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1426/2866] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:30:43 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:30:43.978092 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:43.988521 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4242d-50c0-4270-843a-0532735c0298 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:44.046602 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:44.047308 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:44.047599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:44.047875 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:44.048581 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:44.050615 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:44.148829 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1441/2867] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:30:43 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:30:44.153772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:44.164414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e726fcb-f72a-46f1-8799-4c80aa2e40ce admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:44.169197 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:44.169853 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:44.170137 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:44.170412 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:44.172033 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:44.172805 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:44.184548 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1427/2868] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:30:44.188568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:44.198710 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45872-7991-431c-8d06-8e1248bf9d29 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:44.204546 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf6773-8128-4bad-af32-b7eb1df4debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:44.205289 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6773-8128-4bad-af32-b7eb1df4debc admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:44.205637 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6773-8128-4bad-af32-b7eb1df4debc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:44.206006 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6773-8128-4bad-af32-b7eb1df4debc admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:44.206800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf6773-8128-4bad-af32-b7eb1df4debc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:44.208587 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf6773-8128-4bad-af32-b7eb1df4debc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:44.219514 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1442/2869] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:30:44.223696 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:44.234135 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac6a89-3f75-427b-bb7e-841cd7b349b6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:44.238506 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:44.239411 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:44.239690 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:44.239966 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] PATH_INFO: `/v3/projects/983fce7909844bb8aa03a9de41d85482/users/d0d17491d93c4c70a3cf38c8dcfd0d5b/roles/d5d4fe9c418e4d439e1de3e11ed84d07` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:44.254618 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983fce7909844bb8aa03a9de41d85482, user_id=d0d17491d93c4c70a3cf38c8dcfd0d5b, role_id=d5d4fe9c418e4d439e1de3e11ed84d07)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:44.257261 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:44.314191 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1428/2870] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:30:44 2022] PUT /identity/v3/projects/983fce7909844bb8aa03a9de41d85482/users/d0d17491d93c4c70a3cf38c8dcfd0d5b/roles/d5d4fe9c418e4d439e1de3e11ed84d07 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:30:44.320027 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196df7c-f941-483b-b266-ca597d411ad8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:44.320364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196df7c-f941-483b-b266-ca597d411ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:44.320690 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196df7c-f941-483b-b266-ca597d411ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:44.339547 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f196df7c-f941-483b-b266-ca597d411ad8 None None] MFA Rules not processed for user `82e6f4474fb345569c3125e43d1dc621`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:30:44.340927 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f196df7c-f941-483b-b266-ca597d411ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:44.397889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1443/2871] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:30:44.408034 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:44.409810 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:44.466145 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918081b2-c502-483c-90b4-5905cdad7a11 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:44.469771 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:44.470408 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:44.470693 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:44.470967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:44.479910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:44.481730 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:44.491090 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1429/2872] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:30:49.681104 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:49.681636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:49.681636 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:49.712318 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] MFA Rules not processed for user `d0d17491d93c4c70a3cf38c8dcfd0d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:30:49.713743 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:49.784526 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1444/2873] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:30:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:30:49.787689 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:49.799244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4753326-b7a4-4b7d-a283-8a721ec52963 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:49.804406 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:49.805072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:49.805359 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:49.805637 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:49.806380 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:49.808355 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:49.887746 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1430/2874] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 18:30:49 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:30:49.892314 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:49.905533 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc4564-b568-4d7c-9b57-049e19d362fd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:49.963678 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:49.964364 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:49.964647 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:49.965722 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:49.966447 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:49.968512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:50.082568 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1445/2875] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 18:30:49 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:30:50.084432 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:50.096289 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbb8ae-de25-4d45-b6df-6967212d64d3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:50.100874 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:50.101539 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:50.101829 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:50.102111 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:50.102845 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:50.104471 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:50.115279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1431/2876] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:30:50.119611 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:50.130142 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f60b5-9b28-4bac-b098-fa457c391413 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:50.134969 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:50.135889 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:50.136174 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:50.136452 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] PATH_INFO: `/v3/projects/cc3ab15a20864eb5bd15ca32b2a181b5/users/a5e9481d29294fe6b27a1c795ad20a52/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:50.153834 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3ab15a20864eb5bd15ca32b2a181b5, user_id=a5e9481d29294fe6b27a1c795ad20a52, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:50.156838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:50.227040 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1446/2877] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:30:50 2022] PUT /identity/v3/projects/cc3ab15a20864eb5bd15ca32b2a181b5/users/a5e9481d29294fe6b27a1c795ad20a52/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:30:50.231216 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:50.241835 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea91db-b1c6-4236-9878-21c75d4ba5b7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:50.299351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb06cb-8031-4eb3-9208-9e089e873150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:50.300025 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb06cb-8031-4eb3-9208-9e089e873150 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:50.300310 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb06cb-8031-4eb3-9208-9e089e873150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:50.300589 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb06cb-8031-4eb3-9208-9e089e873150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:50.301317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb06cb-8031-4eb3-9208-9e089e873150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:50.302903 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb06cb-8031-4eb3-9208-9e089e873150 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:50.313446 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1432/2878] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 18:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:30:50.317610 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:50.329250 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b31f4-697d-48e5-9f20-d3c68ed0f866 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:50.334220 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:50.335123 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:50.343769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:50.343769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] PATH_INFO: `/v3/projects/cc3ab15a20864eb5bd15ca32b2a181b5/users/a5e9481d29294fe6b27a1c795ad20a52/roles/e868f254ca154187867dcf5b7aa59a04` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:50.343769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3ab15a20864eb5bd15ca32b2a181b5, user_id=a5e9481d29294fe6b27a1c795ad20a52, role_id=e868f254ca154187867dcf5b7aa59a04)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:50.343769 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:50.350624 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1447/2879] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 18:30:50 2022] PUT /identity/v3/projects/cc3ab15a20864eb5bd15ca32b2a181b5/users/a5e9481d29294fe6b27a1c795ad20a52/roles/e868f254ca154187867dcf5b7aa59a04 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:30:55.953353 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa140fa-f2c5-4cc8-886c-aa6d9849d12e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:55.953985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa140fa-f2c5-4cc8-886c-aa6d9849d12e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:55.953985 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa140fa-f2c5-4cc8-886c-aa6d9849d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:55.982895 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3aa140fa-f2c5-4cc8-886c-aa6d9849d12e None None] MFA Rules not processed for user `a5e9481d29294fe6b27a1c795ad20a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:30:55.983552 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3aa140fa-f2c5-4cc8-886c-aa6d9849d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:56.054968 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1433/2880] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:30:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:30:56.066926 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:30:56.068597 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:30:56.180599 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37e3c-f153-404b-a8ea-42d838f02935 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:30:56.186650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:30:56.187470 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:30:56.187751 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:30:56.188043 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:30:56.252448 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:30:56.254212 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:30:56.264983 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1448/2881] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:30:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:31:20.673906 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:31:20.674473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:31:20.674473 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:31:20.693630 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] MFA Rules not processed for user `d0d17491d93c4c70a3cf38c8dcfd0d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:31:20.694830 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:31:20.701645 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1434/2882] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:31:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:31:20.738657 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:31:20.741379 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:31:20.797266 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ead6c-00f3-48eb-bbc1-c9d57adb4050 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:31:20.800866 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:31:20.801511 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:31:20.801800 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:31:20.802075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:31:20.803877 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:31:20.817512 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:31:20.818973 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:31:20.832892 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1449/2883] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:31:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:31:39.489849 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:31:39.543778 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b6b51-667b-44e7-be99-0501f695ab21 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:31:39.547513 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:31:39.548438 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:31:39.548754 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:31:39.549035 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:31:39.557910 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:31:39.559397 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:31:39.569228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1435/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:31:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:31:41.500108 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:31:41.512428 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28772-e7d4-4bc1-8e46-b727437adf04 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:31:41.518780 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:31:41.519472 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:31:41.519754 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:31:41.520028 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:31:41.521827 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:31:41.536476 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:31:41.538189 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:31:41.550214 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1450/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:33:10.206267 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:33:10.207721 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:33:10.219338 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6c17a-69f0-498a-9814-751ba24b9c82 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:33:10.222943 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:33:10.223607 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:33:10.223894 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:33:10.224174 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:33:10.225897 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:33:10.235534 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:33:10.236945 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c8775-b31b-474f-9af9-9dce0c128af4 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:33:10.245545 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1436/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:33:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:33:58.561133 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:33:58.573304 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f6b70-b3e0-4c22-af11-48103279c62d service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:33:58.579185 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:33:58.579841 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:33:58.580129 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:33:58.580411 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:33:58.582317 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:33:58.597291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:33:58.598897 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:33:58.611162 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1451/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:33:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:34:00.437807 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:34:00.438351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:34:00.438351 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:34:00.456060 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] MFA Rules not processed for user `d0d17491d93c4c70a3cf38c8dcfd0d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:34:00.457307 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:34:00.465171 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1437/2888] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:34:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:34:00.777562 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:34:00.787049 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3386-65b2-49bd-b590-a216b18be3a6 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:34:00.791200 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:34:00.791838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:34:00.792122 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:34:00.792401 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:34:00.794151 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:34:00.803589 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:34:00.805630 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:34:00.813633 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1452/2889] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:34:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:34:02.790226 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:34:02.791681 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:34:02.883362 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cd89-6c95-4dbc-b53c-bcfec751bf91 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:34:02.888228 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953157-f66a-4545-8875-09be3a287804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:34:02.888867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953157-f66a-4545-8875-09be3a287804 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:34:02.889150 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953157-f66a-4545-8875-09be3a287804 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:34:02.889428 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953157-f66a-4545-8875-09be3a287804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:34:02.891223 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-86953157-f66a-4545-8875-09be3a287804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:34:02.902798 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953157-f66a-4545-8875-09be3a287804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:34:02.904401 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953157-f66a-4545-8875-09be3a287804 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:34:02.915036 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1438/2890] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:34:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:34:17.447508 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:34:17.467297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757362d-41e0-4242-a08b-f899ddb82dc8 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:34:17.467297 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:34:17.467810 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:34:17.467921 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:34:17.468198 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:34:17.470050 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:34:17.483616 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:34:17.485222 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:34:17.497738 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1453/2891] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:34:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:35:11.504660 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953157-f66a-4545-8875-09be3a287804 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:35:11.506079 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-86953157-f66a-4545-8875-09be3a287804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:35:11.518833 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953157-f66a-4545-8875-09be3a287804 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:35:11.524121 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:35:11.524759 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:35:11.525046 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:35:11.525327 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:35:11.527077 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:35:11.539237 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:35:11.540818 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e644ad-05c1-4b5b-a7df-6a6022140332 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:35:11.551472 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1439/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:35:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:36:13.035823 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:36:13.037199 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:36:13.049141 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e92b31-f06c-4c5e-b8f8-e997f87b75f4 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:36:13.052650 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:36:13.053276 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:36:13.053773 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:36:13.054062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:36:13.062567 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:36:13.064038 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:36:13.073036 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1454/2893] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:36:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:36:24.611461 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:36:24.612010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:36:24.612010 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:36:24.629821 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] MFA Rules not processed for user `d0d17491d93c4c70a3cf38c8dcfd0d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:36:24.630946 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:36:24.638954 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1440/2894] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 18:36:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:36:24.675062 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:36:24.683556 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba110-bb77-4876-abdd-8954d046e605 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:36:24.687082 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ee1066de2a40f988f50b9b48a0ac5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:36:24.687717 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:36:24.687990 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:36:24.688259 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:36:24.698859 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:36:24.700305 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:36:24.711905 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1455/2895] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:36:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:36:45.747378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:36:45.757014 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b358ce-bfed-4a35-8cd7-044e6a22d642 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:36:45.761044 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:36:45.761621 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:36:45.761907 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:36:45.762186 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:36:45.771089 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:36:45.772772 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:36:45.783124 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1441/2896] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:36:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:36:48.034302 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:36:48.047064 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde9af-dc90-414d-8b84-f288700f8402 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:36:48.052838 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8eeb8fcc242428cb31dc31e25e7865f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:36:48.053478 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:36:48.053957 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:36:48.054230 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:36:48.066253 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:36:48.067893 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:36:48.082705 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1456/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:36:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:38:16.216887 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:38:16.254007 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde51a8-9005-4a71-ae20-075043513fe3 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:38:16.257888 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:38:16.258578 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:38:16.258866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:38:16.259181 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:38:16.266527 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:38:16.268040 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:38:16.276158 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1442/2898] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:38:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:38:53.352059 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:38:53.371359 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8acb7-7ffe-4a9e-9fd6-ace1b8ba01b2 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:38:53.375072 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635272c212ea47379b70362109b4804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:38:53.375712 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:38:53.375996 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:38:53.376301 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:38:53.466910 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:38:53.468375 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:38:53.487742 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1457/2899] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:39:01.022961 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:39:01.036317 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba331b-f001-4f68-9ae1-78d0f843af4b service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:39:01.041378 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:39:01.042244 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:39:01.042529 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:39:01.042866 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] PATH_INFO: `/v3/users/d0d17491d93c4c70a3cf38c8dcfd0d5b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:39:01.044106 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d17491d93c4c70a3cf38c8dcfd0d5b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:39:01.046012 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:39:01.259072 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d17491d93c4c70a3cf38c8dcfd0d5b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.259774 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d17491d93c4c70a3cf38c8dcfd0d5b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.271441 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d17491d93c4c70a3cf38c8dcfd0d5b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.271955 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d17491d93c4c70a3cf38c8dcfd0d5b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.341080 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d17491d93c4c70a3cf38c8dcfd0d5b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.354339 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1443/2900] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:39:01 2022] DELETE /identity/v3/users/d0d17491d93c4c70a3cf38c8dcfd0d5b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:39:01.623939 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:39:01.637291 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c97c84-7730-4f04-af25-e40cee3ab7c6 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:39:01.697209 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:39:01.698075 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:39:01.698363 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:39:01.698644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] PATH_INFO: `/v3/projects/983fce7909844bb8aa03a9de41d85482` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:39:01.699862 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983fce7909844bb8aa03a9de41d85482)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:39:01.701777 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:39:01.837680 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983fce7909844bb8aa03a9de41d85482', 'request_id': 'req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.912916 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983fce7909844bb8aa03a9de41d85482', 'request_id': 'req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.920644 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983fce7909844bb8aa03a9de41d85482', 'request_id': 'req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.943793 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] The token cache is being invalidate because project 983fce7909844bb8aa03a9de41d85482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:39:01.944084 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.944811 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:01.946730 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1458/2901] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:39:01 2022] DELETE /identity/v3/projects/983fce7909844bb8aa03a9de41d85482 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:39:01.950757 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:39:01.955740 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:39:01.975192 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a5c4-0d1b-4490-8ed9-6ad6f57c6799 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:39:02.030246 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:39:02.031138 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:39:02.031418 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:39:02.031687 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] PATH_INFO: `/v3/users/a5e9481d29294fe6b27a1c795ad20a52` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:39:02.032867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e9481d29294fe6b27a1c795ad20a52)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:39:02.034766 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:39:02.211253 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e9481d29294fe6b27a1c795ad20a52'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.212279 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e9481d29294fe6b27a1c795ad20a52'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.224867 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e9481d29294fe6b27a1c795ad20a52'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.225561 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e9481d29294fe6b27a1c795ad20a52'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.318528 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e9481d29294fe6b27a1c795ad20a52'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.331967 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1444/2902] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 18:39:01 2022] DELETE /identity/v3/users/a5e9481d29294fe6b27a1c795ad20a52 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:39:02.594554 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:39:02.596368 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:39:02.611974 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca2f6-327e-4c7a-b062-82ae29c40b81 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:39:02.672155 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e6f4474fb345569c3125e43d1dc621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e6c823fef84e7e88dc9cd3e45439fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:39:02.673344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:39:02.673344 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:39:02.673643 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] PATH_INFO: `/v3/projects/cc3ab15a20864eb5bd15ca32b2a181b5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:39:02.674762 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3ab15a20864eb5bd15ca32b2a181b5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:39:02.676784 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:39:02.793100 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3ab15a20864eb5bd15ca32b2a181b5', 'request_id': 'req-7a8200f6-d394-4207-863d-8c9de4d4f678'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.867787 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3ab15a20864eb5bd15ca32b2a181b5', 'request_id': 'req-7a8200f6-d394-4207-863d-8c9de4d4f678'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.873711 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3ab15a20864eb5bd15ca32b2a181b5', 'request_id': 'req-7a8200f6-d394-4207-863d-8c9de4d4f678'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.884481 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] The token cache is being invalidate because project cc3ab15a20864eb5bd15ca32b2a181b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:39:02.884766 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.885405 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7a8200f6-d394-4207-863d-8c9de4d4f678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:39:02.886966 dv-cinder-840511-4-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1459/2903] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 18:39:02 2022] DELETE /identity/v3/projects/cc3ab15a20864eb5bd15ca32b2a181b5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:40:14.471414 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:40:14.472988 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:40:14.564061 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e179f-5752-4091-b4cd-f86f8abae1b6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:40:14.622921 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd702379f5004159abc50fab8d398a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da492a67660e4d75b1cf92a8e8e575c7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:40:14.623644 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:40:14.624097 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:40:14.624376 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:40:14.626184 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:40:14.637733 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:40:14.647464 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15df513-c88f-40ad-b625-48c1eb9620c7 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:40:14.650163 dv-cinder-840511-4-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1445/2904] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 18:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)